Failing to run AWS Glue workers with AWS RDS PostgresSQL14.7

0

I am trying to load data from my AWS RDS PostgreSQL v14.7 instance hosted on ECS, and I kept getting the following error whenever I test my connection in the AWS Glue connectors:

Check that your connection definition references your JDBC database with correct URL syntax, username, and password. Full SSL connection to data store using host matching failed. The authentication type 10 is not supported. Check that you have configured the pg_hba.conf file to include the client's IP address or subnet, and that it is using an authentication scheme supported by the driver.

I then uploaded a JDBC driver v42.6.0 on a dedicated S3 bucket and specified the path in the crawler connection as the following (I cannot afford to downgrade the Postgres instance version): Enter image description here

Now the test connection is giving a non-supported error for custom uploaded JDBC drivers, so I immediately tried to run my crawlers on the connection. No matter the size of specified schema, the crawler takes 15 minutes and then fails with the following error message in CloudWatch (I would appreciate it if I can find more informative error messages in some other way): ERROR : Internal Service Exception

My database/table/column names are all snake_case. I confirmed that the data source is within the same VPC. I configured an unresitrcted outbound security group rule from the RDS instance, and yet nothing has worked out for me

질문됨 일 년 전68회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠