DMS - Opensearch 2 - BULK failed: contains an unknown parameter [_type]

Question

Hello,

I'm trying to configure a Database migration task to copy data from RDS Aurora (MySQL compatible) to Opensearch 2.3. 
If I enable the properties ParallelLoadThreads & ParallelLoadBufferSize then I have an error and nothing is copied:

```
Elasticsearch: BULK send request failed SourceTable:xxxxxxxxxxxxx TargetIndex:xxxxxxxxxxxxxxx Operation:BULK Failed Completely  DocumentCount:xxxx   ES HttpCode:400 ESErrorResponse: 
{
    "error": {
        "root_cause": [
            {
                "type": "illegal_argument_exception",
                "reason": "Action/metadata line [1] contains an unknown parameter [_type]"
            }
        ],
        "type": "illegal_argument_exception",
        "reason": "Action/metadata line [1] contains an unknown parameter [_type]"
    },
    "status": 400
}
```

I guess it is due to the new version as the type has been removed. 
Is there a specific property to enable to solve this issue? I can't find anything in the documentation except the property UseNewMappingType but it only solves the issue with _doc. Or just DMS is not compatible with opensearch 2.3 at the moment?

Thanks in advance.

Best,
Ben

Ben · Answer

It works now with DMS 3.5.1 but it doesn't manage the insert or update correctly if data are desynchronized.

rePost-User-0022340 · Answer

I am facing the same issue, DMS 3.4.7 with UseNewMappingType = true, I can import the data in single thread, if enable the multi thread, unknown parameter [_type] error returned.

Looks like the DMS still sending the _type to OpenSearch Bulk API, hope they will resolve the issue soon.

Philip

DMS -> Opensearch 2 - BULK failed: contains an unknown parameter [_type]

Add your answer

Relevant content