Can we export the mongodb using the data pipeline?
Howdy. . Customer wants to use the data pipeline to schedule a job, exporting data from mongodb in json format, and then import it to the dynamodb. I checked the developer guide, but it says that the supported data nodes are dynamodb/mysql/redshift/s3.
My guess is that the customer should perform the export in mongodb native way to s3, and then, we can use the data pipeline to import the data to dynamodb.
Just give me a light on it. Thanks, in advance.
- Language
- English
asked 11 years ago806 views
- Newest
- Most votes
- Most comments
You don't need a specific data node to do this. You could schedule an EC2 instance with a shell command activity (http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-shellcommandactivity.html), which would contact the API endpoint of the mongo-cluster to call the export method, download the JSON, and upload it to DynamoDB.
Relevant content
- AWS OFFICIALUpdated 4 years ago
