Migrate from ElasticSearch to AWS OpenSearch

Hello,

You can use AWS DMS to migrate data to Amazon OpenSearch Service (OpenSearch Service). When AWS DMS creates indexes for a target endpoint for OpenSearch Service, it creates one index for each table from the source endpoint.

Configure your OpenSearch Service cluster with compute and storage resources that are appropriate for the scope of your migration. We recommend that you consider the following factors, depending on the replication task you want to use:

• For a full data load, consider the total amount of data that you want to migrate, and also the speed of the transfer.
• For replicating ongoing changes, consider the frequency of updates, and your end-to-end latency requirements.

Following pipeline can be considered, if it matches your business use case:

Aurora DB --> DMS --> OpenSearch

[+] Using an Amazon OpenSearch Service cluster as a target for AWS Database Migration Service - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.Elasticsearch.html

[+] Sources for AWS DMS - Source endpoints for data migration - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.Sources.html#CHAP_Introduction.Sources.DataMigration

[+] Targets for AWS DMS - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.Targets.html

Hi, did you already read https://docs.aws.amazon.com/opensearch-service/latest/developerguide/migration.html ?

https://bonsai.io/blog/migrating-from-elasticsearch-to-opensearch is also interesting

Thanks, but I need the solution for real time replication from Aurora DB (MySQL) to Open Search. Nowadays we are using Logstash which is saturating my DB instances. Thats why I am looking for any other solution, like replicating from Binary Logs to OpenSearch (but I am not sure if it is possible).

Thanks you Rajat. Do you know if I could use JOINS or VIEWS inside the AWS DMS Rules? I need to make first full load and than CDC to have new/changed records.