Glue transform columns limit

0

A customer has a schema with 183 columns, When running a transform job on Glue we are faced with an error:

"Number of columns in schema exceeded the maximum allowed number"

I was able to re-produce.
I can't find in the Glue documentation such a limit.
Is there a way to increase. the limit or a workaround?

AWS
管理員
已提問 4 年前檢視次數 1526 次
1 個回答
0
已接受的答案

As stated here: https://docs.aws.amazon.com/glue/latest/dg/machine-learning.html

The data source table that you choose for the job can't have more than 100 columns.

已回答 4 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南