EMR Serverless Application Disk Space?

0

When configuring an EMR Serverless application, you can choose the disk size for your preinitialized capacity and a maximum disk limit for the application:

Disk size

However, at least for Hive jobs, EMR Serverless stores both the scratch and warehouse directories on S3. So what is this configured disk space used for? I've searched the documentation and there's no mention of how this space is used, or why it's needed.

Patrick
已提問 2 年前檢視次數 1108 次
1 個回答
1
已接受的答案

EMR Serverless uses disk size for the following purposes.

  1. Storing the log files ( Hive, Tez AM logs, Tez Task logs etc)
  2. Shuffle data is stored on the local disk.
  3. Resources such as aux libraries, user jar etc.

Hope it answers your question.

AWS
已回答 1 年前
AWS
支援工程師
已審閱 23 天前
  • This does answer the question, thanks. But we needed this answer 3 months ago. We've since moved our company's infrastructure to a new cloud provider.

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南