Can we export the mongodb using the data pipeline?

Question

Howdy.
.
Customer wants to use the data pipeline to schedule a job, exporting data from mongodb in json format, and then import it to the dynamodb. I checked the developer guide, but it says that the supported data nodes are dynamodb/mysql/redshift/s3. 

My guess is that the customer should perform the export in mongodb native way to s3, and then, we can use the data pipeline to import the data to dynamodb.

Just give me a light on it. Thanks, in advance.

AWS-User-9033290 · Answer

You don't need a specific data node to do this. You could schedule an EC2 instance with a shell command activity (http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-shellcommandactivity.html), which would contact the API endpoint of the mongo-cluster to call the export method, download the JSON, and upload it to DynamoDB.

Can we export the mongodb using the data pipeline?

Relevant content