By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Updating data in governed tables

0

Are governed tables insert/append only? Is it possible to update data already in the table? https://aws.amazon.com/blogs/big-data/part-3-effective-data-lakes-using-aws-lake-formation-part-3-using-acid-transactions-on-governed-tables/ has a good example of inserting data, but it doesn't look possible to define a primary key to be able to dedupilcate data if you did another insert on the same row or a way to do an update.

Thanks

  • AWS-User-5606360
    2 years ago

    I see that for update-table-objects the etag is required "The Amazon S3 ETag of the object. Returned by GetTableObjects for validation and used to identify changes to the underlying data." so does that help with updates? What about with compaction when that s3 file doesn't exist and was compacted

Topics
AnalyticsStorage
Tags
Data LakesAWS Lake Formation
Language
English
AWS-User-5606360
asked 2 years ago1599 views
2 Answers
0

Hi,

Lake Formation Governed Tables support object level ACID transactions. Record level transactions are not currently supported.

hope this helps

AWS
EXPERT
Fabrizio@AWS
answered 2 years ago
0

It appears that the development team is still working on the update table method to support appends on Governed Tables. They are targeting Q1 2022 to have this feature complete. So as of now, there is no method that you can use out of the box to do an update based on the primary key.

AWS-User-1287467
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content