1개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
0
PostgreSQL WAL logs are in binary format mainly used for backup and streaming replication and cannot be parsed by any other application or services. To capture the steam of changes to the PostgreSQL database , you can implement logical replication as mentioned in https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_PostgreSQL.html#PostgreSQL.Concepts.General.FeatureSupport.LogicalReplication as the source for kinesis data stream.
답변함 2년 전
관련 콘텐츠
AWS 공식업데이트됨 2년 전- AWS 공식업데이트됨 2년 전
Hi Raj, thanks for clarifying , so what i understood here , i) these WAL logs has only useful in backup and recovery , streaming replication etc. but same WAL logs (which is binary in nature) cannot parse by any application like python , i mean it can not be converted into a typical database record . please correct me. 2) here we wants to use this WAL logs as a source and want to transform such logs into a database record. after that , delta capture needs to do from WAL logs which is different for each table. but i believe WAL logs capture all the logs in database irrespective of changes in all the database tables ( for e.g. 10 tables are getting insert and updated) 3) As we can implement logical replication , so what is purpose of replication ? i believe , WAL logs are not meant for processing Delta records or any ETL transformation work , please correct me . Thanks in Advance