Skip to content

How does Athena prepare a cluster of compute nodes for a specific query?

0

Athena runs all queries in a shared regional cluster.

When you submit a query, the Athena engine query planner estimates the compute capacity required to run the query and prepares a cluster of compute nodes accordingly. Some queries like DDL queries run on only one node. Complex queries over large data sets run on much bigger clusters.

How is the Athena cluster that is shared between all customers in a region different from the cluster that is prepared for a specific query?

asked 2 years ago507 views

1 Answer
2
Accepted Answer
  • Shared Regional Cluster: This refers to the overall pool of compute resources available within a specific AWS region. All users in that region share this pool. Think of it as the total available infrastructure that Athena can draw from. This can also be referred to as the "regional compute pool" or "regional resource pool."

  • Query-Specific Cluster: When you run a query, Athena temporarily allocates a subset of nodes from the shared regional cluster to form a dedicated cluster for your query. This is tailored to the specific needs of your query, such as its complexity and data size. Once the query is completed, these resources are returned to the shared pool. You can also refer to this as the "dedicated query cluster" or "dynamic query cluster".

answered 2 years ago

EXPERT

reviewed 2 years ago

EXPERT

reviewed 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.