Questions tagged with Aurora PostgreSQL
Content language: English
Sort by most recent
Hi AWS expert, I have a code read data from AWS aurora PostgreSQL, I want to bookmark the table with custom column named 'ceres_mono_index'. But it seems like the bookmark is still uses the primary key as the bookmark key instead of column 'ceres_mono_index'. Here is the code
```python
cb_ceres = glueContext.create_dynamic_frame.from_options(
connection_type="postgresql",
connection_options={
"url": f"jdbc:postgresql://{ENDPOINT}:5432/{DBNAME}",
"dbtable": "xxxxx_raw_ceres",
"user": username,
"password": password,
},
additional_options={"jobBookmarkKeys": ["ceres_mono_index"], "jobBookmarkKeysSortOrder": "asc"},
transformation_ctx="cb_ceres_bookmark",
)
```
How could I fix the issue? Thank you
Newer versions of Amazon Aurora PostgreSQL-compatible edition are now available and database cluster(s) running Aurora PostgreSQL minor versions 11.13, 11.14, 11.15, 12.8, 12.10, 13.4, 13.5, and 13.6 need to be upgraded by September 15, 2023. These newer minor versions include important updates that will improve the operations of your Aurora PostgreSQL instances and workloads. We strongly encourage you to upgrade to at least a recommended minimum minor version at your earliest convenience.
* For PostgreSQL Minor Version 11.13, 11.14, and 11.15, the recommended minimum minor version is 11.18.
* For PostgreSQL Minor Version 12.8 and 12.10, the recommended minimum minor version is 12.13.
* For PostgreSQL Minor Version 13.4, 13.5 and 13.6, the recommended minimum minor version is 13.9.
Starting on or after 12:00 PM PDT on September 15, 2023, if your Amazon Aurora PostgreSQL cluster has not been upgraded to a newer minor version, we will schedule the relevant recommended minimum minor version to be automatically applied during your next maintenance window. Changes will apply to your cluster during your next maintenance window even if auto minor version upgrade is disabled.
Restoration of Amazon Aurora PostgreSQL 11.13, 11.14, 11.15, 12.8, 12.10, 13.4, 13.5, and 13.6 database snapshots after September 15, 2023 will result in an automatic upgrade of the restored database to a supported version at the time.
How to Determine Which Instances are Running These Minor Versions?
* In the Amazon RDS console, you can see details about a database cluster, including the Aurora PostgreSQL version of instances in the cluster, by choosing Databases from the console's navigation pane.
* To view DB cluster information by using the AWS CLI, use the describe-db-clusters command.
* To view DB cluster information using the Amazon RDS API, use the DescribeDBClusters operation. You can also query a database directly to get the version number by querying the aurora_version() system function i.e., "SELECT * FROM aurora_version();".
How to Apply a New Minor Version
You can apply a new minor version in the AWS Management Console, via the AWS CLI, or via the RDS API. Customers using CloudFormation are advised to apply updates in CloudFormation. We advise you to take a manual snapshot before upgrading. For detailed upgrade procedures, please see the available User Guide [1]. Please be aware that your cluster will experience a short period of downtime when the update is applied.
Visit the Aurora Version Policy [2] and the documentation [3] for more information and detailed release notes about minor versions, including existing supported versions.
If you have any questions or concerns, the AWS Support Team is available on AWS re:Post and via Premium Support [4].
[1] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_UpgradeDBInstance.PostgreSQL.html
[2] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/Aurora.VersionPolicy.html
[3] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraPostgreSQL.Updates.20180305.html
[4] https://aws.amazon.com/support
We are streaming the CDC data using DMS and clients are consuming it. While consuming the DMS event, clients are unable to identify primary key in a DMS event. Do we have any transformation rule of DMS which can add primary key automatically to the DMS event?
Is there a way we can refresh a limited set of data from Prod AWS account to Dev AWS account PostgreSQL database?
For e.g., I have to refresh few rows from couple of tables of Prod to Dev DB. I don't want to do a full refresh of the data using snapshots.
Database: AWS Aurora PostgreSQL
Hi, I'm trying to create a copy of an Aurora PostgreSQL cluster snapshot in a different region using the aws cli, I was able to do it five times, but now I'm getting the error message **Cannot copy more than 5 snapshots concurrently to the same region**.
I suspect that the problem was that I deleted those snapshots while they were being copied and for some reason the status was never updated.
##### Question:
do I have to contact the technical support so that they can update the status of the snapshots in the region or is there a way to clean up the snapshots that were deleted before copy them?
Would it be possible to setup an Aurora serverless v2 in us-east-1 and have a read replica in another region (us-west-2)? How could we do this via console?
How do we enable TLS in ORACLE_FDW. As I understand we need to create a wallet and ingest the server side certificate. But how do we do that? Is that even possible?
How can we change SQLNET.ENCRYPTION_CLIENT = Accepted to Requested in Oracle_FDW extension? Which parameter has to be changed?
Hello Team
Is it possible to downgrade my Aurora Postgres instance from db.t3.large to db.t3.small , im not getting the option to choose the smaller instance when i try to modify the instance.
regards
we have our data in AWS RDS postgres db. We have a table with around 100-200 rows and we loaded up 200M rows in 3 hours timeframe. That table is indexed as well. And now we want to insert more data into the table and we see that adding 20M rows is taking 5 hours.
Our instance size is db.r6g.xlarge. And we have two AZ. I want to know the reason for slower performance in query operation and what is the best way to import that huge data into postgres table.
I need to change the default timezone of AWS Aurora PostgreSQL cluster from UTC to CST. We can change it by creating a custom cluster parameter group and then use it in the cluster.
Now my question is what will happen during daylight savings? Will there be any impact of daylight savings to the DB cluster? Do we need to make any change regarding daylight savings in the cluster, instance? Do we need to reboot the cluster?
Please suggest.
To generate a bash script to automate the process of creating snapshots of aroura psql database backup and export the same to s3 bucket with aws iam credentials cron job for every 3 hours and hold snapshots for 30 days