AWS Glue 对变换列的数量限制

0

【以下的问题经过翻译处理】客户有一个包含 183 列的表结构，在 Glue 上运行转换作业时遇到如下错误：

"Number of columns in schema exceeded the maximum allowed number"

我也能够重现以上问题，但在 Glue 文档中找不到这样的限制。

有没有办法解除该限制或者是否有其他的解决方法？

Topics

Tags

Language

中文 (简体)

EXPERT

rePost Polyglot

asked 5 months ago36 views

1 Answer

Newest
Most votes
Most comments

Are these answers helpful? Upvote the correct answer to help the community benefit from your knowledge.

0

【以下的回答经过翻译处理】请参考链接文档中的说明：https://docs.aws.amazon.com/glue/latest/dg/machine-learning.html

The data source table that you choose for the job can't have more than 100 columns.

EXPERT

rePost Polyglot

answered 5 months ago

Relevant content

sagemaker美国人口普查数据在中国宁夏区下载提示拒绝访问
LiuChuang
asked a year ago
S3上无法使用Chunked上传文件｜ Unable to use Chunked to upload files on S3
rePost-User-1798329
asked a year ago
如何讓 IAM 使用者只看的到自己建立的資源 ( How to allow IAM users to only see resources they have created.)
Accepted Answer
kerokero
asked 2 months ago
Sites on Amplify become very slow recently. Amplify站点最近突然变得很慢。
Zhu
asked 10 months ago
How does the AWS Glue crawler detect the schema?
AWS OFFICIALUpdated 2 years ago
Why does my AWS Glue ETL job fail with the error "Container killed by YARN for exceeding memory limits"?
AWS OFFICIALUpdated 2 years ago
How do I resolve the "Unable to infer schema" exception in AWS Glue?
AWS OFFICIALUpdated 3 years ago
How can I resolve the error "You have exceeded the allowed number of AWS accounts." for AWS Organizations?
AWS OFFICIALUpdated a year ago
Push down queries when using the Google BigQuery Connector for AWS Glue
EXPERT
Fabrizio@AWS
published 2 years ago
AWS Glue Dynamic Frame – JDBC Performance Tuning Configuration
EXPERT
AWSRB
published a year ago