1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
Hello there, in order to verify from the logs whether files related to partitions are getting deleted or not you can look for the something similar as below
Deleted log LOG_DIR/<topic>/00000000022134078627.log.deleted
Deleted time index LOG_DIR/<topic>/00000000022134078627.timeindex.deleted
When retention kicks in you will be noticing deletion of log and time index files in the broker logs. That indicates retention is successfully triggered and deleted old log segments.
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 2 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr
- AWS OFFICIALAktualisiert vor 3 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr
Thank you! Yes I have noticed such logs, but still, the disk usage is constantly growing, while we have about 99% of records eligible for deletion. This records are in __consumer_offsets topic where we commit last message every 100 millis even if there are no new messages for hours.