Failed ETL Job

1

Hi,

I'm trying to write data from an RDS Aurora database (source) to S3 (target) using an AWS Glue job and I'm getting this error:

py4j.protocol.Py4JJavaError: An error occurred while calling o107.pyWriteDynamicFrame.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 4, ip-172-30-x-x.ec2.internal, executor 1): com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

The last packet successfully received from the server was 129,902 milliseconds ago. The last packet sent successfully to the server was 129,902 milliseconds ago.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
...
Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.

Any idea of what could be happening?

1010010
질문됨 5년 전484회 조회
1개 답변
0

Hi, I've got the same error when trying to ETL from S3 to RDS Aurora Servrless destination, but connection test in Glue UI is shown as successful.
Job run ID: jr_d538e6bd5b30686c1d9a5b12fea74e131ab64308ad3c7ee03991ec0ebf2885e8
Have you been able to resolve this issue?

답변함 5년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠