1 Answer
- Newest
- Most votes
- Most comments
0
Hello,
Generally, the last columns are the partitions.So, you can try get schema and then convert to list and read last n columns which are partitions.
As a solution other than in PySpark you can do get table API call and get the partitions and use them in code.
https://awscli.amazonaws.com/v2/documentation/api/latest/reference/glue/get-table.html#output
Relevant content
- Accepted Answerasked 6 months ago
- asked 2 years ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated 4 months ago