Skip to content

Redshift provisioned cluster storage - Mismatched information between AWS doc and the pricing offer details

0

Hi,

My main question is related to interpreting the storage limits for Redshift provisioned cluster in your article here, as I see these data may not match what I see in downloaded offer file.

  1. The document mentioned "ra3.4xlarge" node type mentioned 128TB is the "managed storage limit per node"; the offer file mentions the max storage is 64TB.
    • question about RA3 4xlarge storage limit
  2. The document mentioned "ra3.16xlarge" node type mentioned 128TB is the "managed storage limit per node"; the offer file mentions the max storage is 64TB.
    • question about RA3 16xlarge storage limit
  3. Side question, also related to the storage capacity, but not comparing the number from the content from your documentation with the offer file - How do we come up with the total storage capacity for "dc2.8xlarge" node type being 326 TB? I thought that the math to calculate total storage capacity is (storage_per_node * ceil_in_node_range), which is 2.56 TB * 128 --> 327.68 TB. The calculated number does not match 326 TB in the documentation. Or does TB in documentation means Tebibytes?
    • question about DC2 8xlarge storage limit
    • Can we also clarify the unit - "GB" - mentioned under column "Storage per node", does GB mean Gigabyte or Gibibyte?
    • Can we also clarify your unit conversion process between "GB" values to "TB" values on this table? To make sure we are on the same page, which formula is your team using: "1TB being 1000GB" or "1TB being 1024GB"?

Please clarify my concern at your earliest convenience. Thank you. Jean

asked a year ago247 views
2 Answers
0

Thank you for your detailed questions about Amazon Redshift provisioned cluster storage. I'll address each of your points:

  1. and 2. Regarding the RA3.4xlarge and RA3.16xlarge node types: There appears to be a discrepancy between the documentation and the pricing offer file. The documentation states a managed storage limit of 128 TB per node for both node types, while the offer file mentions a maximum storage of 64 TB. This inconsistency could be due to several factors:
  • The documentation might be referring to the total managed storage capacity across all nodes in a cluster, rather than per individual node.
  • There may have been recent updates to the storage capacities that haven't been reflected in all places.
  • The offer file might be showing a different metric, such as the base storage included before additional charges apply.

Without more context, it's difficult to determine which is correct. It would be best to contact AWS support for clarification on this discrepancy.

  1. Regarding the DC2.8xlarge total storage capacity: The slight difference between the calculated 327.68 TB and the documented 326 TB could be due to rounding or the use of different units. The documentation might indeed be using tebibytes (TiB) rather than terabytes (TB), which could account for the small discrepancy.

1 TiB is approximately 1.1 TB, so 326 TiB would be about 358.6 TB. This is closer to your calculation of 327.68 TB, but still not exact. The difference could be due to some overhead or reserved space in the cluster that isn't available for user data.

For the most accurate and up-to-date information on storage capacities and limits, it's recommended to consult with AWS support or your account representative. They can provide the most current details and explain any discrepancies between different sources of information.
Sources
Amazon Redshift provisioned clusters - Amazon Redshift
Considerations for using Amazon Redshift provisioned clusters - Amazon Redshift
Amazon Redshift provisioned clusters overview - Amazon Redshift

answered a year ago
  • Wanting to comment on the Generative AI answer (also to provide more context to my description):

    • The documentation might be referring to the total managed storage capacity across all nodes in a cluster, rather than per individual node.
      • This is inaccurate to me. According to the documentation (same link in my original post), the total managed storage capacity and per-node storage capacity are both visible in separate columns in the same table. My question 1 and 2 are explicit to the per-node managed storage capacity.
0

Hello Jean!

Thank you for reporting this issues. It appears there is a disparity between the documentation and offer file regarding the Storage units mentioned. To ensure that the documentation and the offer file are updated accurately we kindly request you to raise a support case to report this so that our team can investigate this discrepancy. Please share the source of the offer file with the team. Please reach out to us if any further assistance is needed. Thank you for your cooperation.

AWS
answered a year ago
  • Thank you Smrithi, will do.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.