1回答
- 新しい順
- 投票が多い順
- コメントが多い順
0
Yes it is possible to process multiple tables in parallel with one Glue job. You can simply call each table in a separate DynamicFrame, and you should be able to process this data.
My only recommendation is that you take into consideration how much of data is being consumed in the job and the type of transformations which are being processed. Too much data will consume more resources. You will need to provide the correct amount of workers and the appropriate worker type for your job.
You can read more about the worker types and their properties via the following documentation
[+] Glue Adding Jobs- https://docs.aws.amazon.com/glue/latest/dg/add-job.html
関連するコンテンツ
- AWS公式更新しました 3年前