By using AWS re:Post, you agree to the Terms of Use

Questions tagged with Amazon Keyspaces

Sort by most recent
  • 1
  • 2
  • 12 / page

Browse through the questions and answers listed below or filter and sort to narrow down your results.

Using DMS and SCT for extracting/migrating data from Cassandra to S3

IHAC who is doing scoping with an Architecture using DMS and SCT. I had a few questions I was hoping you can get answered for me. 1. Does AWS DMS support data validation with Cassandra as a source? I don’t see it here - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html#CHAP_BestPractices.DataValidation but I do see Cassandra as a valid source target here https://aws.amazon.com/about-aws/whats-new/2018/09/aws-dms-aws-sct-now-support-the-migration-of-apache-cassandra-databases/ 2. Does AWS DMS support ongoing replication with Cassandra as a source? Reading the docs it looks like if I wanted to extract data from Cassandra and write to s3 (Using DMS) then post process that data into a different format (Like json) and write to a different S3 bucket, I could so by attaching a Lamba to the original S3 event from the DMS extract and drop. Can you confirm my understanding? 3. How is incremental data loaded ongoing after initial load from Cassandra (with DMS)? In the docs it looks like its stored in s3 in csv form. Does it write 1 csv per source table and keep appending or updating the existing csv? does it create 1 csv per row, per batch...etc? I’m wondering how the event in step 3 would be triggered if I did want to continuously post process updates as they come in in real time and covert source data from Cassandra into Json data I store on s3.
0
answers
0
votes
71
views
asked 5 months ago

Can't access created keyspace/table via Java API

I have created a keyspace and tables via the AWS Console, and inserted some sample data via the console CQL editor, but I can't appear to access them via the Java API. I have successfully configured the driver/session and ran the sample program as mentioned in the developer docs( ResultSet rs = session.execute("select * from system_schema.keyspaces");). But when I attempt to run a simple select statement that works in the Console CQL editor I get a datastax error: _Exception in thread "main" com.datastax.oss.driver.api.core.servererrors.InvalidQueryException: unconfigured table table_keyspace.table_name_ My searching leads me to believe that error message means the keyspace/table don't exist. Is there something obvious I’m missing? If I can connect via the sample program, why can't I connect via the API? Here is the config/code for reference: datastax-java-driver { basic.contact-points = \[ "cassandra.us-east-2.amazonaws.com:9142"] advanced.auth-provider{ class = PlainTextAuthProvider username = "xxxxxxx" password = "xxxxxxxx" } basic.load-balancing-policy { local-datacenter = "us-east-2" } advanced.ssl-engine-factory { class = DefaultSslEngineFactory truststore-path = "./src/main/resources/key/cassandra_truststore.jks" truststore-password = "xxxxxxx" } metadata { schema.enabled = false token-map.enabled = false } connection.warn-on-init-error = false } **public class CassandraTestClass {** **public static void main( String\[] args )** **{** **//Use DriverConfigLoader to load your configuration file** **DriverConfigLoader loader = DriverConfigLoader.fromClasspath("application.conf");** **try (CqlSession session = CqlSession.builder()** **.withConfigLoader(loader)** **.build()) {** **ResultSet rs = session.execute("SELECT ** FROM test_keyspace.test_table_name;");* **Row row = rs.one();** **System.out.println(row.getString("id"));** **}** **}** **}** Edited by: lkalland on Dec 23, 2020 10:21 AM Edited by: lkalland on Dec 23, 2020 10:24 AM Edited by: lkalland on Dec 23, 2020 10:27 AM Edited by: lkalland on Dec 23, 2020 10:28 AM
1
answers
0
votes
40
views
asked 2 years ago
  • 1
  • 2
  • 12 / page