1回答
- 新しい順
- 投票が多い順
- コメントが多い順
0
Hello,
I would like to inform DynamicFrame is similar to a DataFrame, except that each record is self-describing, so no schema is required initially. Instead, AWS Glue computes a schema on-the-fly when required. Basically Glue DynamicFrame is based on RDD due to which show() method does not work directly and you need to convert dynamic frame to dataframe first to check the data in tabular format.
dyf.printSchema()
dyf.toDF().show()
回答済み 2年前
関連するコンテンツ
- 質問済み 6ヶ月前
- AWS公式更新しました 3年前
- AWS公式更新しました 2年前
- AWS公式更新しました 3年前
- AWS公式更新しました 3年前
Converting the Glue DynamicFrame to a Spark DataFrame and using the show method is from my point of view a workaround. As you can see in the AWS Documentation, Glue DynamicFrames are supposed to have a show method as well: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-crawler-pyspark-extensions-dynamic-frame.html#aws-glue-api-crawler-pyspark-extensions-dynamic-frame-show
But this method does not work so this seems to be a bug. Will AWS provide a fix for that?