1 Answer
- Newest
- Most votes
- Most comments
1
Hello.
I haven't seen the code and query you are using so I don't know the details, but if I delete 's3://bucket_name/path/manifest.csv' as the error message says, will the query run?
If you can share the query and code you are running, could you please do so?
Relevant content
- asked 2 years ago
- asked 2 years ago
- asked 10 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 4 months ago
Hello.
When I checked the "manifest.csv" file after this error, the file did not exist. I also checked that it worked well when I re-run the query.
It is difficult to share all the codes, but the code in the query part is as follows. code:
I think parallel execution is a problem. Is there any way to fix it?
Thank you for sharing the code. I'm not sure if it will lead to a direct solution, but how about fixing the number of concurrent executions of Lambda to 1 as described in the GitHub issue below? https://github.com/aws/aws-sdk-pandas/issues/2651#issuecomment-1955081562
Also, can I run the query with a smaller number of parallel executions, such as 10 instead of 100?
Thank you for your reply. Let's apply the concurrency limit to the issue.