Glue job error - Error while List shards

0

Getting error while connecting streaming data from kinesis to redshift with few transformations using visual ETL. (using amazon kinesis - glue data catalog table as source ). Schema is already defined prior, hence crawler is not used. Error Category: UNCLASSIFIED_ERROR; StreamingQueryException: Query [id = 30dc3a82xxx, runId = ba421exxxx] terminated with exception: Error while List shards

  • Thank you. Adding kinesis endpoint worked. If I'm connecting through external source to redshift (eg. psycopg2) getting same kind of error to establish connection to redshift and same to connect tableau. Is it a similar problem?

1개 답변
1
수락된 답변

Check the driver error logs, that could be a permission issue, that the stream is in a different region or similar

profile pictureAWS
전문가
답변함 한 달 전
profile picture
전문가
검토됨 한 달 전
  • Checked region and permissions which seems correct. Tried another method to directly stream into redshift using external schema and materialized view , even then getting error - error: Unable to describe stream code: 42001 ,Timeout was reached Stream name: name query: -1[child_sequence:1] location: kinesis_client.

  • Timeout normally means you are running in a VPC without internet or a kinesis endpoint (could also be the security group but is less likely)

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠