Resolution
----------

Use Amazon CloudWatch to [monitor AWS Glue streaming job metrics](https://docs.aws.amazon.com/glue/latest/dg/monitoring-awsglue-with-cloudwatch-metrics.html). Then, check the failed streaming job's logs for error messages, warnings, or timestamps. For more information, see [Gathering AWS Glue troubleshooting information](https://docs.aws.amazon.com/glue/latest/dg/troubleshooting-contact-support.html).

Verify that the job's data sources and sinks are accessible and configured correctly. For more information, see [Input sources](https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#input-sources) and [Output sinks](https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#output-sinks) on the Apache Spark website. 

Use [AWS Glue Schema Registry](https://aws.amazon.com/blogs/big-data/integrate-aws-glue-schema-registry-with-the-aws-glue-data-catalog-to-enable-effective-schema-enforcement-in-streaming-analytics-use-cases/) to discover, control, and evolve data stream schemas. Verify that the input data schemas match the expected schemas in the streaming job.

Before you deploy the streaming job, use AWS Glue [Docker images](https://aws.amazon.com/blogs/big-data/develop-and-test-aws-glue-version-3-0-jobs-locally-using-a-docker-container/) or [AWS Glue ETL library](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-libraries.html#develop-using-etl-library) to develop and test it locally.

Related information
-------------------

[How do I optimize AWS Glue streaming jobs?](https://repost.aws/knowledge-center/glue-optimize-streaming-job)

[Troubleshooting AWS Glue](https://docs.aws.amazon.com/glue/latest/dg/troubleshooting-glue.html)

[Kinesis connections](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-connect-kinesis-home.html)

[Kafka connections](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-connect-kafka-home.html)

[Developing using a Docker image](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-libraries.html#develop-local-docker-image)

I want to troubleshoot my failed AWS Glue streaming job.

How do I troubleshoot an AWS Glue streaming job?

Analytics

Come posso risolvere l'errore "The specified queue does not exist or you do not have access to it." quando eseguo il mio job AWS Glue per inviare messaggi ad Amazon SQS in un'altra Regione?

How do I troubleshoot an AWS Glue streaming job?

Resolution

Related information

Contenuto pertinente