By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Glue transform columns limit

0

A customer has a schema with 183 columns, When running a transform job on Glue we are faced with an error:

"Number of columns in schema exceeded the maximum allowed number"

I was able to re-produce.
I can't find in the Glue documentation such a limit.
Is there a way to increase. the limit or a workaround?

Topics
Analytics
Tags
AWS Glue
Language
English
AWS
MODERATOR
AWS-User-3380374
asked 4 years ago1526 views
1 Answer
0
Accepted Answer

As stated here: https://docs.aws.amazon.com/glue/latest/dg/machine-learning.html

The data source table that you choose for the job can't have more than 100 columns.

AWS-User-8730979
answered 4 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content