EMR Serverless Application Disk Space?

0

When configuring an EMR Serverless application, you can choose the disk size for your preinitialized capacity and a maximum disk limit for the application:

Disk size

However, at least for Hive jobs, EMR Serverless stores both the scratch and warehouse directories on S3. So what is this configured disk space used for? I've searched the documentation and there's no mention of how this space is used, or why it's needed.

Patrick
已提问 2 年前1107 查看次数
1 回答
1
已接受的回答

EMR Serverless uses disk size for the following purposes.

  1. Storing the log files ( Hive, Tez AM logs, Tez Task logs etc)
  2. Shuffle data is stored on the local disk.
  3. Resources such as aux libraries, user jar etc.

Hope it answers your question.

AWS
已回答 1 年前
AWS
支持工程师
已审核 23 天前
  • This does answer the question, thanks. But we needed this answer 3 months ago. We've since moved our company's infrastructure to a new cloud provider.

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则