


 Resolution
-----------



You can't configure Amazon EMR to use Amazon S3 instead of HDFS for the Hadoop storage layer. HDFS and the EMR File System (EMRFS), which uses Amazon S3, are both compatible with Amazon EMR, but they're not interchangeable. HDFS is an implementation of the Hadoop FileSystem API, which models POSIX file system behavior. EMRFS is an object store, not a file system. For more information, see Hadoop documentation for [Object Stores vs. Filesystems](https://hadoop.apache.org/docs/stable2/hadoop-project-dist/hadoop-common/filesystem/introduction.html#Object_Stores_vs._Filesystems).


For an overview of the storage layers in Amazon EMR, see [Overview of Amazon EMR architecture](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-overview-arch.html).


For recommendations about when to use each file system, see [Work with storage and file systems](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-file-systems.html).





---




 Related information
--------------------



[EMR File System (EMRFS)](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-fs.html)


[HDFS configuration](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hdfs-config.html)







I want to configure Amazon EMR to use Amazon Simple Storage Service (Amazon S3) as the Apache Hadoop storage system instead of the Hadoop Distributed File System (HDFS).

Configure Amazon EMR to use Amazon S3 instead of HDFS

Can I use Amazon S3 for Hadoop storage instead of HDFS?

Can I use Amazon S3 for Hadoop storage instead of HDFS?

Resolution

Related information

Contenido relevante