Updating data in governed tables
Are governed tables insert/append only? Is it possible to update data already in the table? https://aws.amazon.com/blogs/big-data/part-3-effective-data-lakes-using-aws-lake-formation-part-3-using-acid-transactions-on-governed-tables/ has a good example of inserting data, but it doesn't look possible to define a primary key to be able to dedupilcate data if you did another insert on the same row or a way to do an update.
I see that for update-table-objects the etag is required "The Amazon S3 ETag of the object. Returned by GetTableObjects for validation and used to identify changes to the underlying data." so does that help with updates? What about with compaction when that s3 file doesn't exist and was compacted
Lake Formation Governed Tables support object level ACID transactions. Record level transactions are not currently supported.
hope this helps
It appears that the development team is still working on the update table method to support appends on Governed Tables. They are targeting Q1 2022 to have this feature complete. So as of now, there is no method that you can use out of the box to do an update based on the primary key.
Is it possible to specify DB snapshot in AWS Lake Formation?Accepted Answerasked a year ago
Lake Formation Governed tables: truncate and reload?asked 4 months ago
Error bringing in additional datasets/tables to Amazon Quicksight Datasetasked 4 months ago
Governed Tables not deleting smaller files after compactionasked a month ago
How to add Timestream data source to Quicksight (Connection is valid, but no tables are found)Accepted Answerasked 5 months ago
Import Existing DynamoDB table schema to NoSQL workbench's Data modelasked 3 years ago
Record Level Upsert on Governed Tablesasked a month ago
Unable to read Hive Acid tables in Athena using Athena Hive data connectorasked a month ago
Updating data in governed tablesasked 7 months ago
List true tables only in Athenaasked 22 days ago