2 Antworten
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
Hi,
You can run it for sure. The thing is that you can´t initialise the env that way.
See this post for inspiration.
https://plainenglish.io/blog/spark-on-aws-lambda-c65877c0ac96
If not, my suggestion here is to change to a Java based Lambda ( Spark and Iceberg are based on Java Virtual Machine).
Bests.
beantwortet vor einem Jahr
0
Hi,
not sure I understand your use case, if you just need to read the Iceberg table from the Lambda Function, a better option might be to invoke a query in Athena using pyAthena or the aws-sdk-pandas, which is provided as a Lambda Layer as well.
if you are trying to run some specific spark jobs and you would like the semplicity of a serverless function you might want to have a look at AWS Glue.
hope this helps
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 3 Jahren
- AWS OFFICIALAktualisiert vor 10 Monaten
- AWS OFFICIALAktualisiert vor 2 Jahren