1 Answer
- Newest
- Most votes
- Most comments
0
Notice that error doesn't mean there is a connectivity issue (especially if you say it works with less data), it means it failed writing and that can be for a number of reasons, for instance the server nodes running out of disk space. Check the lines around that error in the log for some further indication on the issue, also you should check the server health status.
Relevant content
- asked 3 months ago
- AWS OFFICIALUpdated 9 days ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
I tried enabling logging on my OSS domain, but I'm not seeing any obvious errors there.
I looked through the job logs in glue and also didn't see anything. Any other suggestions?
Check in SparkUI, if it failed at the point when trying to store data, you should see failed tasks with the corresponding error