Database

I'm trying to setup cascading replication from RDS PosgresSQL instances, using logical replication (test_decoding), that will be used by Fivetran. As I don't want to connect any 3-rd party tools to Primary database, I'm trying to setup logical replication on replica, so the flow will look like: Primary (RDS.Postres with HA) -> Replica (RDS.Postres RO replica) --(test_decoding)--> Fivetran. I've followed the steps from this article: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_PostgreSQL.html#PostgreSQL.Concepts.General.FeatureSupport.LogicalReplication (setup parameter & restart database). Seems logical replication was successfully enabled on Primary (wal_level = logical) but the same steps on replica are not working (wal_level = replica). I've tried with different PG versions as there was a mention, that cascading option is available since 14.1 - I'm currently using 14.2 with no luck. Is there anything more I need to enable in order to get this working? Or is such design not supported at all on Manged RDS PostgresSQL Replica?

HI Team, I see only 12.1 & 19c allowed on RDS custom... is it possible to install other versions of Oracle as well?

Hello, I have created a PostgreSQL database, including the PostGIS extension, however, I'm unable to create GiST index on my rast column. I'm trying to execute the following line: ``` CREATE INDEX IF NOT EXISTS rast_index ON public.raster_data USING gist(rast); ``` I get the following response: ``` ERROR: data type raster has no default operator class for access method "gist" HINT: You must specify an operator class for the index or define a default operator class for the data type. SQL state: 42704 ```

IHAC who is doing scoping with an Architecture using DMS and SCT. I had a few questions I was hoping you can get answered for me. 1. Does AWS DMS support data validation with Cassandra as a source? I don’t see it here - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.DataValidation but I do see Cassandra as a valid source target here https://aws.amazon.com/about-aws/whats-new/2018/09/aws-dms-aws-sct-now-support-the-migration-of-apache-cassandra-databases/ 2. Does AWS DMS support ongoing replication with Cassandra as a source? Reading the docs it looks like if I wanted to extract data from Cassandra and write to s3 (Using DMS) then post process that data into a different format (Like json) and write to a different S3 bucket, I could so by attaching a Lamba to the original S3 event from the DMS extract and drop. Can you confirm my understanding? 3. How is incremental data loaded ongoing after initial load from Cassandra (with DMS)? In the docs it looks like its stored in s3 in csv form. Does it write 1 csv per source table and keep appending or updating the existing csv? does it create 1 csv per row, per batch...etc? I’m wondering how the event in step 3 would be triggered if I did want to continuously post process updates as they come in in real time and covert source data from Cassandra into Json data I store on s3.

Giving an example : Let's say I am in AWS region A , in AWS Account AA & have a Elasticache cluster ECA. And I export the backup of ECA to S3 bucket SBA. Now in another region B, if I have an account AB and Elasticache ECB, would ECB be able to read from SBA (s3 bucket of first account )?

Hello, It seems that the Availability Zone option on the "Add a reader" wizard is missing. Does anybody can confirm/infirm this ? Thanks

Hi, According to [MariaDB docs](https://mariadb.com/kb/en/optimizer-switch/), i should be able to change every possible option on or off. When i try to switch value for optimizer_switch `rowid_filter=off` in Amazon RDS -> Parameter groups, i got an error like below: > Error saving: Invalid parameter value: rowid_filter=off for: optimizer_switch allowed values are: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on (Service: AmazonRDS; Status Code: 400; Error Code: InvalidParameterValue; Request ID: 5f849923-efbc-4edc-822d-8648a0f86b9b; Proxy: null) * Pasting whole config value with `rowid_filter=off` throws the same error. * Pasting whole config value without `rowid_filter` turn on that feature - because of defaults like mentioned in docs above * Putting only value `rowid_filter=off` throws error * Engine version: 10.4.24 How can i turn one specific option off?

Hello, I'm trying to bind the NFS mount for my aws storage gateway fileshare doing the following command: ``` mount -t nfs -o nolock,hard FILESHARE_IP:/tc-latam-afi-oracle-db [MountPath] ``` When I do so I get the following: ``` mount.nfs: mounting FILESHARE_IP:/tc-latam-afi-oracle-db failed, reason given by server: No such file or directory ``` For context this is in an Oracle Linux 8.5 machine. I've tried other methods to mount but no avail.

Running into issue with [ExecuteStatement](https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_ExecuteStatement.html). The result returned both "LastEvaluatedKey" and "NextToken" but when we fed it into the next "ExecuteStatement" as part of "input", we keep getting an error "NextToken does not match request". ``` const input = { Statement: '...', Parameter: [...] }; let end = false; let nextInput = input; while (!end) { const { LastEvaluatedKey, NextToken, ...rest } = await new ExecuteStatementCommand(nextInput); LastEvaluatedKey === undefined ? end = true : nextInput = { NextToken, ...input }; } ``` Saw this other [question regarding LastEvaluatedKey](https://www.repost.aws/questions/QUgNPbBYWiRoOlMsJv-XzrWg/how-to-use-last-evaluated-key-in-execute-statement-request) which was helpful. However, the proposed solution does not work as our key value is date based (i.e. pulling data based on a date range). So, the query result ended with numerous duplicate items created on same date.

**Summary**: Dynamo DB commands from the CLI do not work when real credentials are set up. The 'endpoint-url' flag should work around this and recognize that localhost endpoints can be hit with no credentials given the default setup of the AWS Dynamo Docker image. Output of command after setting credentials: `An error occurred (ResourceNotFoundException) when calling the DescribeTable operation: Cannot do operations on a non-existent table` Is there a fix or workaround for this? **System**: MacOS Monterey version 12.0.1, Macbook Pro - M1 - 2020 ``` 'aws --version' -> aws-cli/2.4.11 Python/3.9.10 Darwin/21.1.0 source/arm64 prompt/off ``` **To reproduce**: -- Start from a terminal that does NOT have AWS Credentials set up via environment variables or anything else -- Start up a local Dynamo DB Instance on Docker: ``` docker pull amazon/dynamodb-local docker run -p 8000:8000 --name=ddblocal -d amazon/dynamodb-local ``` -- Create a table: ``` aws dynamodb create-table --attribute-definitions "[{ \"AttributeName\": \"key\", \"AttributeType\": \"S\"}, { \"AttributeName\": \"valueA\", \"AttributeType\": \"S\"}]" --table-name test_table --key-schema "[{\"AttributeName\": \"key\", \"KeyType\": \"HASH\"}, {\"AttributeName\": \"valueA\", \"KeyType\": \"RANGE\"}]" --endpoint-url "http://localhost:8000" --provisioned-throughput "{\"ReadCapacityUnits\": 100, \"WriteCapacityUnits\": 100}" --region local ``` -- Query the table (to prove it works): ``` aws dynamodb describe-table --table-name test_table --region local --endpoint-url "http://localhost:8000" ``` -- Set your real AWS Credentials: ``` export AWS_ACCESS_KEY_ID="<REAL KEY ID HERE>" export AWS_SECRET_ACCESS_KEY="<REAL SECRET KEY HERE>" export AWS_SESSION_TOKEN="REAL TOKEN HERE>" ``` -- Query the table again (This one fails for me - see output above) ``` aws dynamodb describe-table --table-name test_table --region local --endpoint-url "http://localhost:8000" ```

Is it possible to connect to AWS service for e.g MySQL DB using private IP from AWS CloudShell on the console. It was in pipeline in 2020 to enable AWS Cloudshell to make connection to other services.

Hello I've a jsp with code (from https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ScanJavaDocumentAPI.html) : ... ``` <%@ page import="com.amazonaws.services.dynamodbv2.AmazonDynamoDB" %> <%@ page import="com.amazonaws.services.dynamodbv2.AmazonDynamoDBClientBuilder" %> <%@ page import="com.amazonaws.services.dynamodbv2.document.DynamoDB" %> <%@ page import="com.amazonaws.services.dynamodbv2.document.Item" %> <%@ page import="com.amazonaws.services.dynamodbv2.document.ItemCollection" %> <%@ page import="com.amazonaws.services.dynamodbv2.document.ScanOutcome" %> <%@ page import="com.amazonaws.services.dynamodbv2.document.Table" %> <%@ page import="com.amazonaws.services.dynamodbv2.model.AttributeValue" %> <%@ page import="com.amazonaws.services.dynamodbv2.model.ScanRequest" %> <%@ page import="com.amazonaws.services.dynamodbv2.model.ScanResult" %> ... <% AmazonDynamoDB client = AmazonDynamoDBClientBuilder.standard().build(); DynamoDB dynamoDB = new DynamoDB(client); String tableName = "TicketsWalletUsersDev"; // Table table = dynamoDB.getTable(tableName); Map<String, AttributeValue> lastKeyEvaluated = null; do { ScanRequest scanRequest = new ScanRequest() .withTableName(tableName) .withLimit(10) .withExclusiveStartKey(lastKeyEvaluated); ScanResult result = client.scan(scanRequest); for (Map<String, AttributeValue> item : result.getItems()){ System.out.println(item.toJSONPretty()); } lastKeyEvaluated = result.getLastEvaluatedKey(); } while (lastKeyEvaluated != null); %> ``` It gives the error: The method toJSONPretty() is undefined for the type Map<String,AttributeValue> I want the string containing the true json and not the string returned from item.toString() that is : {addresses={M: {mobile+75@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1583142338893,}, verified={BOOL: true}},}, federico+11@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1581332986414,}, verified={BOOL: true}},}, federico+signup3@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1581330211793,}, verified={BOOL: true}},}, federico+33@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1581330013122,}, verified={BOOL: true}},}, mobile@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1583162677615,}, verified={BOOL: true}},}, federico+12@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1581333042026,}, verified={BOOL: true}},}, federico+2@nearit.com={M: {requestId={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6_1581332941950,}, verified={BOOL: true}},}},}, created={S: 2020-02-05T10:40:17.887Z,}, userName={S: 909b1963-0ed4-4ac1-9b71-846239ed5bf6,}} Thanks!

A DynamoDB table suddenly shows error "Key not found in KeySchema.". We didn't change settings. It worked before. We can't explore items now. Obviously it's a bug. Please fix it.

I would like to enable unlimited mode on the Elasticache Tx node types but I am unable to find information on how to enable/configure this. The following mentions T3 instances launch with unlimited mode by default, does that include Elasticache instances? https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/burstable-performance-instances-how-to.html#modify-burstable-performance-instances

I have csv data uploaded to S3 bucket, letting Glue to set them up as tables for later use. I want all the columns loaded as string without designating each column name by name. How could we configure Glue to load all columns as string, not transforming into bigint or so?

I would like to deploy a multi tenant web application say `webapp.com` and I would like each customer to have their own subdomain like `app.customer1.webapp.com`, `api.customer1.webapp.com`, `app.customer2.webapp.com`, `api.customer2.webapp.com`, etc. This was each customer has their own API and Web App URL. I would like all web app urls to go to the same instance of the application but load a different configuration for each customer - each customer has their own cognito userpool. Similarly for API but I would need to authenticate based on Bearer Token and Domain used. For the backend I think I will have a dynamodb table to hold the details of each customer. The web app is NextJS app so I think I will use a fargate cluster for both the web app and api (I want to avoid API Gateway and lambda). I will also use CDK for all infrastructure so I might also use it to bootstrap each customer using a stack that consists of Route53 configs and other resources like userpool that is unique to each customer. What is the easiest way to achieve this (preferably with CDK) ?

Hi All, We've identified that our RDS Aurora (Postgresql-13.6) cluster is a key bottleneck in our application's performance. Until we can rearchitect the code, we were hoping to try and mitigate some of this through infrastructure changes. We're going to add additional read replicas to help reduce the amount of calls and hopefully allow more parallel processing to take place. I'm having trouble pinpointing if there's a way to use a single endpoint, as we do now with our single write instance, and through some AWS feature have the queries be routed properly to the read and write instances based on the type of query. As opposed to making code changes where we have two sessions, one for read and one for write. I assume there must be a way but I can't seem find an exact answer. If someone can post relevant documentation for me to review, that would be perfect, thank you!

Greetings! I have an application that utilizes a DynamoDB table to manage counters. When we update the value of the counter, we consume the returned value - this returned value is the old value of the counter. This counter is then used to retrieve a value in an array, it is effectively an index. I currently increment these counters with Lambda functions - it's highly likely that many Lambdas may attempt to update the value of a given counter at the same time. It's important that each Lambda function receives a different value of the counter. Utilizing DynamoDB atomic counters, can I expect that each Lambda function will receive a different value for the counter? Example: * 10 Lambdas attempt to update value of a counter where its current value is 0 * The Update Expression is "ADD count :incr" where ":incr" is 1 * Each Lambdas update is processed * The returned value from each update is unique per Lambda and the values are 0 - 9 * The final value of the counter is 10