Skip to content

AWS BATCH: Container Overrides length must be at most 8192

0

We are trying to start an aws batch job. The job definition has over 40 parameters which are referenced in the command (example below).

When starting a batch job we get the error "Container Overrides length must be at most 8192". What is causing this issue? Is there a work around this issue? Can the limit be increased?

      Parameters: {
          "command": "output",
          ...
      }
      ContainerProperties:
        Command:
        - python3
        - main.py
        - --command
        - Ref::command
        ...

A solution we've come up with involves uploading some of the larger parameter values to S3. And have the batch job download the data when it runs. Which seems to work. But still wondering if there is a native aws batch approach to solving this, perhaps can the limit be inceased?

asked 10 months ago151 views
1 Answer
1

Hello.

I don't think that value can be increased.
Therefore, you need to deal with it by placing the file in S3 or using Systems Manager Parameter Store, as you did.
https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_RunTask.html

A total of 8192 characters are allowed for overrides. This limit includes the JSON formatting characters of the override structure.

EXPERT
answered 10 months ago
EXPERT
reviewed 10 months ago
EXPERT
reviewed 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.