All news with #s3 batch operations tag

Amazon S3 adds compute checksum to verify datasets

🔒 Amazon Web Services has added a compute checksum operation to S3 Batch Operations, enabling large-scale verification of stored datasets without restoring or downloading objects. You can submit a manifest or target a bucket with prefix/suffix filters, select algorithms such as SHA-256, MD5, CRC32C and others, and receive a detailed integrity report when the job completes. This capability complements S3's built-in validation and simplifies compliance, preservation, and accuracy checks across all storage classes and object sizes.