How do I inject multiple table items (indexed) in the Ingestion Pipelines ?

0

We have developed an open search service in Ohio. We have attached a screenshot of our service details (IngestionPipelines.png).

Ingestion Pipeline Service

In that open search, we are inserting data from the Ohio region table (ProductsList-mrnq4x7gv5hn7kahw7x63evkaq-dev).

At the time, the table item structure was linked to another table item with an index, and we have included the model JSON.

{
    "ProductCategoryId": "150",
    "ProductCategoryName": "Software Products",
    "ProductId": "A01398",
    "ProductName": "Talkabout T8367",
    "ProductPrice": 15.7,
    "id": "A01398",
    "ProductsDiscounts": {
        "items": [
            {
                "Customer": "CP100140",
                "ProductDiscount": -5,
                "id": "00000000-0001-1DDF-BA84-90CC8386DCE3-A01398",
                "productID": "A01398"
            }
        ]
    },
    "ProductsPrices": {
        "items": [
            {
                "ProductPrice": "1400$",
                "ProductPriceCurrencyCode": "USD",
                "id": "00000000-0001-1DDF-BA84-90CC8386DCE3-A01398",
                "productID": "A01398"
            }
        ]
    },
    "UserFavouriteProducts": {
        "items": [
            {
                "FavouriteStatus": "active",
                "id": "ecc8381f-3775-48fd-a10f-b9dd5c148eaa",
                "productID": "A01398"
            }
        ]
    }
}

The two tables are product price (ProductPrices-mrnq4x7gv5hn7kahw7x63evkaq-dev) and product discount (ProductDiscounts-mrnq4x7gv5hn7kahw7x63evkaq-dev).

We created those tables within the Amplify application. We have attached screenshots of that amplify schema. amplify sachema

Following injection, just the initial table elements were uploaded to the open search, not the related table items. We have included the JSON file.

{ "ProductCategoryId": "150", "ProductCategoryName": "Software Products", "ProductId": "A01398", "ProductName": "Talkabout T8367", "ProductPrice": 15.7, "id": "A01398", "ProductsDiscounts": "00000000-0001-1DDF-BA84-90CC8386DCE3-A01398", "ProductsPrices": "00000000-0001-1DDF-BA84-90CC8386DCE3-A01398", "UserFavouriteProducts":"ecc8381f-3775-48fd-a10f-b9dd5c148eaa", }

We now need instructions on how to set up an open search with Serverless and upload many table elements.

1 Answer
1
Accepted Answer

Please review the below documentations and configure the OpenSearch ingestion pipeline for DynamoDB as Source. In case, you need further assistance to review the resources in your account, I recommend creating AWS Support Case.

[1] https://docs.aws.amazon.com/opensearch-service/latest/developerguide/configure-client-ddb.html [2] https://opensearch.org/docs/latest/data-prepper/pipelines/configuration/sources/dynamo-db/ [3] https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/OpenSearchIngestionForDynamoDB.html

profile pictureAWS
SUPPORT ENGINEER
answered 24 days ago
profile picture
EXPERT
reviewed 24 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions