Partitioning by column A could be advantageous in your use case and then groupBy column B in order to limit the number of partitions. You can create a dynamic frame and refer to partitions in it with predicate pushdown. Do you want to create multiple dynamic frames for multiple partitions and then combine them using join operator ? If you have any sample code you are using on a sample dataset, please share it with us on a support case and we can assist you by getting on a screen-share.
- Accepted Answerasked a month ago
- AWS OFFICIALUpdated 2 months ago
- How can I troubleshoot the error "FAILED: SemanticException table is not partitioned but partition spec exists" in Athena?AWS OFFICIALUpdated 8 months ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated 10 months ago
- EXPERTpublished 6 months ago