Limitations on Step Functions SDK Integration for Elasticsearch
After "Announcement: AWS Step Functions adds support for over 200 AWS Services with AWS SDK Integration": https://forums.aws.amazon.com/ann.jspa?annID=8933
We wanted to use the new AWS SDK Integration in Step Functions to start up a OpenSearch/Elasticsearch Domain, however Step Functions does not seem to support the EBSOptions parameter https://docs.aws.amazon.com/opensearch-service/latest/developerguide/configuration-api.html#configuration-api-datatypes-ebsoptions, as it errors with:
The Parameters '{\"ElasticsearchClusterConfig\":{\"InstanceType\":\"t3.small.elasticsearch\",\"InstanceCount\":1,\"DedicatedMasterEnabled\":false,\"ZoneAwarenessEnabled\":false},\"DomainName\":\"test-12345\",\"ElasticsearchVersion\":\"7.1\",\"EBSOptions\":{\"EBSEnabled\":true,\"VolumeType\":\"gp2\",\"VolumeSize\":100},\"VPCOptions\":OMITTED,\"AccessPolicies\":OMITTED}' could not be used to start the Task: The field \"EBSOptions\" is not supported by Step Functions
The same parameters work just fine using boto3.
Is this by design? Should we expect support in the future or it is never going to be an option? Is there any documentation about these limitations?
Is there a workaround other than using the SDK directly in a Lambda?
Edited by: LPKTech on Oct 22, 2021 5:15 AM - Fix formatting of the error and added detail about it running on boto3
Hi
The parameters are Pascal case so instead you can use EbsOptions and it should work.
Thanks
That works (I had to do the same with VPCOptions and other fields)
A similar issue that came up though is on the Tags field though on the same ElasticSearch creation:
The field "Tags" is not supported by Step Functions
Any idea on how to fix this one?
Relevant questions
AWS Step Function Output for container services
asked 9 days agoDo Lambda functions called inside Step Functions still have a 250MB package limit?
Accepted Answeraws step functions dynamodb service integration & updating dynamic items
Accepted Answerasked 5 months agoAWS Step functions Api Gateway integration RequestBody.$ bug
asked a year agoStep Function - dynamodb query with Boolean Filter
Accepted Answerasked 3 months agoIncompatibility between State.EnteredTime and the DynamoDB .Net SDK
asked 18 days agoLimitations on Step Functions SDK Integration for Elasticsearch
Accepted Answerasked 7 months agoStep Function Retry Metrics
asked 3 months agoLatency in Step function for express workflow invoked from aws sdk java v2
asked 2 months agoThrottlingException from Step Function triggered through API Endpoint
asked 2 years ago