Whether you're taking your first steps with Kubernetes or you're an experienced practitioner looking to sharpen your skills, our Amazon EKS workshop series delivers practical, real-world experience that moves you forward. Learn directly from AWS solutions architects and EKS specialists through hands-on sessions designed to build your confidence with Kubernetes. Register now and start building with Amazon EKS!
S3 - Checksum Validation on Objects > 5GB
Using s3 batch copy along with the additional checksum on the objects works fine, but this doesn't seem to be supported for objects larger than 5GB.
For objects larger than 5 GB, S3 batch with lambda as an operation is helpful but there is no option to add the additional checksum validation for this.
How can the additional checksum for larger objects (>5GB) can be enabled?
Thanks
- Topics
- Storage
- Language
- English
- Newest
- Most votes
- Most comments
Hello,
You can check this blog post which talks about building checksums on multi part uploads on S3 objects: https://aws.amazon.com/blogs/media/building-scalable-checksums/
Hope this helps!
Relevant content
- asked 2 years ago
- AWS OFFICIALUpdated 2 months ago
Thanks Sivaram! I did infact, look at this and see it as an option; Just that I think validation of checksum can be cumbersome (depending on the number) in this approach as we may have to utilize ListObjectsV2 call to generate a manifest of sorts as the operation is limited to 1K keys per call.