Help us improve the AWS re:Post Knowledge Center by sharing your feedback in a brief survey. Your input can influence how we create and update our content to better support your AWS journey.
How do I troubleshoot an AWS Glue streaming job?
I want to troubleshoot my failed AWS Glue streaming job.
Resolution
Use Amazon CloudWatch to monitor AWS Glue streaming job metrics. Then, check the failed streaming job's logs for error messages, warnings, or timestamps. For more information, see Gathering AWS Glue troubleshooting information.
Verify that the job's data sources and sinks are accessible and configured correctly. For more information, see Input sources and Output sinks on the Apache Spark website.
Use AWS Glue Schema Registry to discover, control, and evolve data stream schemas. Verify that the input data schemas match the expected schemas in the streaming job.
Before you deploy the streaming job, use AWS Glue Docker images or AWS Glue ETL library to develop and test it locally.
Related information
Relevant content
- asked 2 months ago
- asked 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 5 months ago
