Batch write if part of the write is too old

0

If I do a batch write of record into time stream in order, but only SOME of the inserts/upserts fail, will the rest of them get written and only the failed ones get put into the reject bucket?

I don't have magnetic store writes enabled, and my memory store duration is 30 days. I'm just trying to figure out what happens if some records are too old to go into the memory store, since I have magnetic writes disabled. I'm OK with them failing and going into the reject bucket as long as the rest of them get written.

Example: I send in ten records, eight go into the memory store, the other 2 are too old. Do I get back a RecordsIngested of:

  • 8 records written to memory store
  • 0 records written to the magnetic store (since it's disabled)
  • 8 records total

and the remaining 2 go to the configured reject bucket?

profile picture
wz2b
asked 8 months ago194 views
1 Answer
1
Accepted Answer

-> If magnetic store is disabled, you cannot setup an Error logs location (reject bucket).
-> If magnetic store is enabled and you ingest the data older than the allowed time range, you get error "Error: An error occurred (RejectedRecordsException) when calling the WriteRecords operation: One or more records have been rejected. See RejectedRecords for details."

So, you will not get the 8 records written as a response but memory write will go successful. The remaining 2 records will go asynchronously to S3 bucket if magnetic write is enabled and log location is setup.

Ref.: https://docs.aws.amazon.com/timestream/latest/developerguide/troubleshoot-rejectedrecords.html

AWS
SUPPORT ENGINEER
AnushaG
answered 8 months ago
profile picture
EXPERT
reviewed a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions