Timestream : unable to set S3 Error logs location on asynchronous magnetic storage

Question

How to set a S3 location to store timestream asynchonous logs ?

I've enable Mggnetic Strorage Writes on Timestream, i need to store historical data.
But, i can't set a location to write error  log S3.

Error logs location - optional
Specify an S3 location for error logs because magnetic storage writes are asynchronous.
Resource URI

I can see my bucket name, choose it, but it's disappear when i came back on table configuration page.
I think, i have to allow timestream to push on my S3 Bucket, but i didn't find the policiy or option to do that.

Thanks for your help

Answer

Hello,

If I understood your question correctly, you were able to set the S3 error logs location, but can't see this location on the table details page?

If so, there are two options to check if this table uses a right S3 path:
* Using CLI run `aws timestream-write describe-table --table-name %tablename% --database-name %databasename%`
* Using console you could go to the table details page and then press "Edit" button. It will show you the path which is currently used by this table.

Hope this will help you.

Answer

Hello, 
thanks for your answer.

if i check with CLI, i have :
aws timestream-write describe-table --table-name %mytable% --database-name %mydb%
{
    "Table": {
        "Arn": "arn:aws:timestream:eu-central-1:%myorg%:database/%mydb%/table/%mytable% ",
        "TableName": "%mytable% ",
        "DatabaseName": "%mydb%",
        "TableStatus": "ACTIVE",
        "RetentionProperties": {
            "MemoryStoreRetentionPeriodInHours": 4,
            "MagneticStoreRetentionPeriodInDays": 36500
        },
        "CreationTime": "2021-12-19T16:51:09.344000+00:00",
        "LastUpdatedTime": "2022-01-06T13:18:45.232000+00:00",
        "MagneticStoreWriteProperties": {
            "EnableMagneticStoreWrites": true,
            "MagneticStoreRejectedDataLocation": {
                "S3Configuration": {
                    "BucketName": "%MYBUCKETISHERE%",
                    "EncryptionOption": "SSE_S3"
                }
            }
        }
    }
}

On My bucket, i have only the name of bucket ( no / and no /foldername)
it's seems set.

But if i trigger error, when i write the same value with a time compatible with magnetic storage, i never see a log into bucket. ( but i can see rejected record with my test software in console mode).

Or maybe, this log will be only use if the write are proceessed asynchrounously ( big batch ) ?

Timestream : unable to set S3 Error logs location on asynchronous magnetic storage

Relevant content