Skip to content

Firehose Postgres to iceberg support eu-central region

0

It seems like a firehose as CDC from Postgres RDS to Iceberg Tables should be supported in the region eu-central-1; however, Postgres RDS doesn't appear in the source drop menu.

asked 2 years ago441 views

1 Answer
1
Accepted Answer

You are correct that Amazon Data Firehose support for replicating database changes from PostgreSQL to Apache Iceberg tables should be available in the eu-central-1 (Frankfurt) region. This feature is generally available in all AWS regions except for AWS China, AWS GovCloud (US), and Asia Pacific (Malaysia).

However, if you're not seeing PostgreSQL RDS as an option in the source drop-down menu, there could be a few reasons for this:

  1. The feature might still be in the process of rolling out in that specific region. AWS sometimes staggers feature releases across regions.

  2. There might be a temporary issue with the Firehose console in that region.

  3. Ensure that you're looking at the correct feature. This functionality is part of the "Database CDC to Apache Iceberg" feature in Firehose, which is different from the standard data delivery to Iceberg tables.

  4. Check if you have the necessary permissions to view and configure this feature in your AWS account.

If the issue persists, it would be advisable to contact AWS support for the most up-to-date information and assistance. They can provide specific details about the availability and any potential issues in the eu-central-1 region.

Remember that this feature allows you to replicate changes from PostgreSQL databases into Apache Iceberg tables, including an initial data copy followed by continuous capture of real-time CDC changes. It supports automatic creation of Iceberg tables matching source database schemas and automatic schema evolution in response to source changes.
Sources
Amazon Data Firehose supports continuous replication of database changes to Apache Iceberg Tables in Amazon S3 - AWS
Replicate database changes to Apache Iceberg Tables with Amazon Data Firehose - Amazon Data Firehose

answered 2 years ago

EXPERT

reviewed 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.