Skip to content

Use parameter store for object-mapping rule for Kafka target in DMS Task Settings

0

Is it possible to get the topic name when using JSON when setting the target endpoint for Kafka?

{
	"rule-type": "object-mapping",
	"rule-id": "3",
	"rule-name": "MapToKafka2",
	"rule-action": "map-record-to-record",
	"kafka-target-topic": "<topic-name-from-ssm-parameter-store>",
	"object-locator": {
		"schema-name": "Test",
		"table-name": "Address"
	},
	"partition-key": {"value": "HomeAddress" }
},

Thank you,

1 Answer
0

Yes, it is possible to get the topic name from AWS Systems Manager Parameter Store when setting up the target endpoint for Kafka in AWS Database Migration Service (DMS) task settings. However, the provided JSON snippet does not directly support retrieving values from Parameter Store.

To use a value from Parameter Store, you would typically need to retrieve the parameter value before creating or updating your DMS task, and then use that value in your task settings. The "kafka-target-topic" field in the object-mapping rule expects a string value for the topic name.

If you want to use a dynamic approach, you could consider using AWS Lambda or another AWS service to retrieve the parameter value from Parameter Store and then use that value to update your DMS task settings programmatically.

It's important to note that while DMS supports flexible configuration for Kafka targets, including the ability to map different source tables to separate Kafka topics using the "kafka-target-topic" attribute, direct integration with Parameter Store for dynamic topic names is not a built-in feature of DMS task settings.

For the most up-to-date and accurate information on DMS capabilities and integration with other AWS services, it's recommended to consult the official AWS documentation or reach out to AWS support.
Sources
Using Apache Kafka as a target for AWS Database Migration Service - AWS Database Migration Service
KafkaSettings - AWS Database Migration Service

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.