Questions tagged with Amazon OpenSearch Service

I am looking for documentation on Auto-scaling using AWS OpenSearch? I found the following article on scale up/down but nothing on auto-scaling. Any information on how to perform auto-scaling using OpenSearch for elasticsearch will be helpful. We currently use Elasticsearch 7.8 and planning to migrate to AWS OpenSearch.lg...

I've found blogs on how to migrate an existing elastisearch domain and its existing documents into an aws opensearch domain. But I'm wondering if there is a source for doing the opposite? Is there a general recommended tool for this procedure?lg...

Hello Everyone, I have a small query related to AWS OpenSearch. We have create a OpenSearch Cluster with 4 Data Nodes and 3 Master Nodes with 2500GB Volume size. Now the issue is 1 data node shows available space is 232 GB and another 3 Data Nodes shows available space is 1345GB. 1329GB,1325GB. As per my understanding Data node 1 store more data as comparison to other Data Nodes. So is there any way that we can split equal amount of data among all the Data Nodes..?lg...

Hello all, I have an AWS OpenSearch domain with ultrawarm/cold storage disabled. On the Cloudwath logs, I get the following error: `2022-09-21T10:45:08.806-04:00 [2022-09-21T14:45:08,452][WARN ][r.suppressed ] [51ae3f769ed44b28bc9af2e0ef420e6a] path: __PATH__ params: {page_size=2000} OpenSearchStatusException[Rejecting request because cold storage is not enabled on the domain. Enabling cold storage for the first time can take several hours. Please try again later.] __AMAZON_INTERNAL__ __AMAZON_INTERNAL__ __AMAZON_INTERNAL__ at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:195) at org.opensearch.indexmanagement.rollup.actionfilter.FieldCapsFilter.apply(FieldCapsFilter.kt:120) at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:193) at org.opensearch.performanceanalyzer.action.PerformanceAnalyzerActionFilter.apply(PerformanceAnalyzerActionFilter.java:99) at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:193) at org.opensearch.security.filter.SecurityFilter.apply0(SecurityFilter.java:319) at org.opensearch.security.filter.SecurityFilter.apply(SecurityFilter.java:154) at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:193) at org.opensearch.action.support.TransportAction.execute(TransportAction.java:170) at org.opensearch.action.support.TransportAction.execute(TransportAction.java:98) at org.opensearch.client.node.NodeClient.executeLocally(NodeClient.java:108) at org.opensearch.client.node.NodeClient.doExecute(NodeClient.java:95) at org.opensearch.client.support.AbstractClient.execute(AbstractClient.java:433) at org.opensearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1325) __AMAZON_INTERNAL__ at org.opensearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:128) at org.opensearch.security.filter.SecurityRestFilter$1.handleRequest(SecurityRestFilter.java:128) at org.opensearch.rest.RestController.dispatchRequest(RestController.java:306) at org.opensearch.rest.RestController.tryAllHandlers(RestController.java:392) at org.opensearch.rest.RestController.dispatchRequest(RestController.java:235) __AMAZON_INTERNAL__` But, I don't have the Cold storage enabled. Let me know what I'm doing wrong. Any ideas?lg...

Can someone help me to understand why my Master JVM Memory Pressure suddenly goes high after I upgraded my Data nodes instance type?lg...

We're testing DMS for syncing our main SQL (PostgreSQL) database into NoSQL (OpenSearch). I've read about tasks, rules & table mappings, but it's not clear what is the preferred way to sync relational data into a non-relational DB, specifically PostgreSQL into OpenSearch. First of all, a few PostgreSQL tables will be migrated to the same OpenSearch index, by flattening the relations into the main document. This means that there should be probably be an order to the sync. For example, let's say in PostgreSQL there is a "Users" table and "UserRoles" table (say 1 to many) where each user role has a user id. And in OpenSearch we have only a "Users" index where each user document can have an array of nested "role" objects (or just an array of strings). Then I would assume that first the "Users" table should be migrated to the "Users" index, and only after that the "UserRoles" table should be migrated by adding a nested object in the "Users" index. How would that be done? Is there a way to control the order DMS syncs the tables? Also, how do I tell DMS that "UserRoles" should be migrated as a nested object and that it should first find the existing user by the user id?lg...

I am new with Opensearch service and we're having high CPU Utilization more than 80% as the maximum. I am thinking if we need to add more nodes or upgrade to higher instance types. Thank you for who can answer my question.lg...

Hello everyone! Faced with the problem. When I opened OpenSearch Dashboards and set auto refresh (Refresh every 5 minutes) for instance and just stay on this page (or even without auto refresh). After some time I redirected to the private tenant (from global). What’s the reason and how to fix it? Thanks in advance.lg...

There's seems to be an issue creating geo_point field types. We have a process that indexes a latitude and longitude coordinate that used to create a geo_point field type and now it creates two separate fields for the lat/lon as float types. This is a real problem since we can no longer perform geo distance searches. We haven't touched the code that performs the indexing so nothing has changed on our end and we can't even create geo_point field types on old version of Elasticsearch. What's going on and how do we create geo_point field types now?lg...

I am trying to connect to Opensearch Version 1.3 using the .net NEST library 7.17 from a .net Core app and I get the error: **Elasticsearch.Net.UnsupportedProductException: 'The client noticed that the server is not Elasticsearch and we do not support this unknown product.'** I tried downgrading to NEST 7.14.1 same issue! Any help would be much appreciated!lg...

Following the tutorial here: https://docs.aws.amazon.com/opensearch-service/latest/developerguide/gsgcreate-domain.html When I click Create (step 13), I get the following message: CreateDomain: {"message":"You don't have permission to select three availability zones"} I'm completely stuck.... any tips? Thanks!lg...

We have 7 rows of data in DynamoDB and we assigned lambda trigger.......the most of tables are working fine but recently made few tables are not working properly. Even if I added new data it has only one single document showing.........CloudWatch indicates no errors............I have no idea......Any one has clue where to look into?lg...