How to get DataFrame index without RDD conversion?

0

Hi, I'm trying to iterate through the results returned from SelectFields action using the following command

SelectFields_node1656679636429.toDF().index

but i get the following error

AttributeError: 'DataFrame' object has no attribute 'index' it appears that even I convert the DynamicFrame to DataFrame, many attributes are missing. I found a workaround using RDD, and re-inialising a new DataFrame, like below

rdd = SelectFields_node1656679636429.toDF().rdd
df = pd.DataFrame(rdd.collect())
df.index

but this approach seems an overhead. Are there any better, native ways of getting the properly initialized DataFrame from DynamicFrame?

Michael
asked 2 years ago63 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions