Emr serverless network configs

2

Hi 👋, I have a couple of questions in emr serverless networking configuration.

  1. I know public subnet is not recommended in backend, but it is not allowed in emr serverless. Any reason why only private subnetting?
  2. If my spark only needs s3 to interact, then dedicated vpc required to be configured?

Thanks in advance

Mark
feita há 7 meses553 visualizações
1 Resposta
3
Resposta aceita

Hello,

  1. EMR serverless creates private ENI for each worker which will consume an IP address on the private subnet where it is launched by design. So, it is recommended only to private subnet in EMR serverless world. Refer here for more.
  2. Without VPC connectivity, a job can access some AWS service endpoints in the same AWS Region. These services include Amazon S3, AWS Glue, Amazon CloudWatch Logs, AWS KMS, AWS Security Token Service, Amazon DynamoDB, and AWS Secrets Manager. You can enable VPC connectivity to access other AWS services through AWS PrivateLink, but you aren't required to do this. To access external services, you can create your application with a VPC. Refer here
AWS
ENGENHEIRO DE SUPORTE
respondido há 7 meses
profile picture
ESPECIALISTA
avaliado há 7 meses
profile pictureAWS
ESPECIALISTA
avaliado há 7 meses
  • Thanks, and if I go with vpc and use s3 endpoint to interact, will there be any performance implications like the traffic hops might be not optimized ?

  • No performance impact. Basically the traffics of VPC endpoints goes within AWS networks which is indeed secure and do not bring latency in traffic.

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas