1 個回答
- 最新
- 最多得票
- 最多評論
0
Hello. There are many factors to this. I am listing some below:
a) What is the instance configuration? Is it sufficient? Do you want to reconsider it?
b) Is auto scaling turned on?
c) What does Spark UI say? Which task takes most time? Is it task that takes more time or more time is spent on waiting for resources?
c) Read over JDBC , how many parallel connections are being used?
d) Are you using dynamic partitions?
These are some high level checklist which needs to be answered.
Most important is the code , are you using repartiton/coalesce? Are you using any collect in code? Code is the main factor which usually causes performance issues. Please feel free to reach out to me if you will need any additional information.
已回答 3 年前
相關內容
- AWS 官方已更新 2 年前
- AWS 官方已更新 1 年前
- AWS 官方已更新 1 年前
- AWS 官方已更新 2 年前