Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

AWS Glue create_dynamic_frame.from_catalog Failed to find data source: UNKNOWN

0

Here is my code snippet:

[transaction_DyF = glueContext.create_dynamic_frame.from_catalog( database = source_db, table_name = source_tbl, push_down_predicate = pushDownPredicate, transformation_ctx = source_tbl)

Error Message:

Error: An error occurred while calling o103.getDynamicFrame.\n: java.lang.ClassNotFoundException: Failed to find data source: UNKNOWN

  • Fayaz
    3 years ago

    Hello - can you please explain from where you trying to read? You can also try from_options if you are trying to read from s3, rds and other sources.

Topics
AnalyticsDatabase
Tags
Extract Transform & Load DataAWS Glue
Language
English
asked 3 years ago1.1K views
1 Answer
0

Calling the create_dynamic_frame.from_catalog is supposed to return a dynamic frame that is created using a Data Catalog database and table provided. However, in this case it is likely that the table input classification is UNKNOWN, when the crawler detects no pattern in files to classify it, a table with a classification UNKNOWN is created.

Check the table properties in Data Catalog for classification. See below link on creating a custom classifier.

AWS
answered 3 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content