Zero-ETL integration failed.
there is one postgreSQL table ,and the table have some column is JSONB. the table sync failed. but the data in PostgreSQL table is is JSONB , how it can be not well format JSON?
the Error message is "Replicating initial data for table "public"."tenant_concept" failed with error 1224. Check the data that might be causing issues. If the issue persists, contact AWS Support."
- Newest
- Most votes
- Most comments
Based on the error you're experiencing with your zero-ETL integration for a PostgreSQL table containing JSONB columns, there are a few important points to consider:
First, while zero-ETL integrations do support JSONB data types from PostgreSQL and map them to the SUPER data type in Amazon Redshift, the issue may not be with the data type itself but potentially with the data content or table structure.
The most common reason for replication failures in zero-ETL integrations is the absence of a primary key in your source table. Zero-ETL integrations require source tables to have primary keys for successful replication. When a table lacks a primary key, the monitoring dashboard in Amazon Redshift typically displays the table status as "Failed" and the overall integration status changes to "Needs attention."
To resolve this issue, you have two options:
- Identify an existing key in your table that can be designated as a primary key
- Add a synthetic primary key to your table
Additionally, check for other potential issues:
- Verify that your JSONB data doesn't contain unsupported structures or values
- Ensure the replication user has proper SELECT permissions on the table
- Confirm that you're not using any custom data types or extensions, as zero-ETL integrations for PostgreSQL don't support these
If you've verified these aspects and the issue persists, you might need to contact AWS Support as suggested in the error message, providing details about your integration ARN and the specific error you're encountering.
Sources
Troubleshooting Aurora zero-ETL integrations - Amazon Aurora
Troubleshooting zero-ETL integrations - Amazon Redshift
Troubleshooting Zero-ETL integration - Oracle Database@AWS
Adding data to a source Aurora DB cluster and querying it - Amazon Aurora
Hi , there are no any other data type just original JSONB in Postgre and all table have primary key.
I want check the data , However all data is ok, I use Python Json lib to verify all data. is possible to know which data have problem?
Relevant content
- asked 3 months ago
- asked a year ago
