OpenSearch migration related

0

Can share the approach on migrating from OpenSearch to OpenSearch Serverless?

asked 17 days ago46 views
2 Answers
0

To migrate from OpenSearch to OpenSearch Serverless, you can use Amazon OpenSearch Ingestion (OSI), which is a fully managed, serverless data collector designed to simplify the migration process. Here's an approach to migrate your data:

  1. Create an IAM role for the OpenSearch Ingestion pipeline with the necessary permissions.

  2. Configure the IAM role to assume the appropriate trust relationship.

  3. Map the OpenSearch Ingestion domain role ARN as a backend user to your existing OpenSearch domain.

  4. Create a new OpenSearch Serverless collection to serve as the destination for your migrated data.

  5. Associate a data policy with the new Serverless collection, granting the OpenSearch Ingestion role the required permissions.

  6. Set up an OpenSearch Ingestion pipeline by specifying the source (your existing OpenSearch domain) and sink (the new OpenSearch Serverless collection) details. Include the necessary IAM roles and enable the OpenSearch Serverless flag.

  7. Validate the pipeline configuration and start the migration process.

  8. Once the migration is complete, verify the ingested data in the target OpenSearch Serverless collection to ensure all your data has been transferred correctly.

This approach allows you to migrate your data without the need for custom code or third-party solutions. It's important to note that this process focuses on data migration. Migration of metadata, such as security roles and dashboard objects, may require additional steps or a separate process.

OpenSearch Ingestion offers the advantage of being able to transform or reindex data from Elasticsearch 7.x versions before ingestion into the OpenSearch Serverless collection. This feature can be particularly useful if you're migrating from an older version of Elasticsearch.

By using OpenSearch Ingestion for migration, you eliminate the need to provision, scale, or manage servers, making the transition to OpenSearch Serverless more straightforward and efficient.
Sources
Use Amazon OpenSearch Ingestion to migrate to Amazon OpenSearch Serverless | AWS Big Data Blog
Migrating data from self-managed OpenSearch clusters using Amazon OpenSearch Ingestion - Amazon OpenSearch Service

profile picture
answered 17 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions