Opensearch Request Entity Too Large

Question

Good morning,
I am trying to bulk reindex on AWS Opensearch but I am getting the following message error:
Caused by: org.elasticsearch.client.ResponseException: method [POST], host [https://vpc-camp-dev-escluster-i3kk3yk6hcgivsxkmu3giujvyu.eu-central-1.es.amazonaws.com:443], URI [/_bulk?refresh=wait_for&timeout=1m], status line [HTTP/1.1 413 Request Entity Too Large]
{
    "Message": "Request size exceeded 10485760 bytes"
}

My backend is written with Java and when I try to execute with the same amount of data on my local Docker Desktop with Elasticsearch it works normally.
Is there any Opensearch limitation that can be upgraded?
Thanks

Answer

From the [ES docs](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/modules-network.html#:~:text=If%20you%20hit%20this%20limit%20when%20sending%20a%20request%20to%20the%20Bulk%20API%2C%20configure%20your%20client%20to%20send%20fewer%20documents%20in%20each%20bulk%20request.%20If%20you%20wish%20to%20index%20individual%20documents%20that%20exceed%20100mb%2C%20pre%2Dprocess%20them%20into%20smaller%20documents%20before%20sending%20them%20to%20Elasticsearch.):

> If you hit this limit when sending a request to the Bulk API, configure your client to send fewer documents in each bulk request. If you wish to index individual documents that exceed 100mb, pre-process them into smaller documents before sending them to Elasticsearch.

Hope this helps!

Opensearch Request Entity Too Large

相关内容