Emr serverless network configs

2

Hi 👋, I have a couple of questions in emr serverless networking configuration.

  1. I know public subnet is not recommended in backend, but it is not allowed in emr serverless. Any reason why only private subnetting?
  2. If my spark only needs s3 to interact, then dedicated vpc required to be configured?

Thanks in advance

Mark
gefragt vor 7 Monaten581 Aufrufe
1 Antwort
3
Akzeptierte Antwort

Hello,

  1. EMR serverless creates private ENI for each worker which will consume an IP address on the private subnet where it is launched by design. So, it is recommended only to private subnet in EMR serverless world. Refer here for more.
  2. Without VPC connectivity, a job can access some AWS service endpoints in the same AWS Region. These services include Amazon S3, AWS Glue, Amazon CloudWatch Logs, AWS KMS, AWS Security Token Service, Amazon DynamoDB, and AWS Secrets Manager. You can enable VPC connectivity to access other AWS services through AWS PrivateLink, but you aren't required to do this. To access external services, you can create your application with a VPC. Refer here
AWS
SUPPORT-TECHNIKER
beantwortet vor 7 Monaten
profile picture
EXPERTE
ĂŒberprĂŒft vor 7 Monaten
profile pictureAWS
EXPERTE
ĂŒberprĂŒft vor 7 Monaten
  • Thanks, and if I go with vpc and use s3 endpoint to interact, will there be any performance implications like the traffic hops might be not optimized ?

  • No performance impact. Basically the traffics of VPC endpoints goes within AWS networks which is indeed secure and do not bring latency in traffic.

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien fĂŒr die Beantwortung von Fragen