All news with #kafka tag

AWS Lambda adds customizable error handling for Kafka

🔁 AWS Lambda now offers enhanced error handling for Amazon Managed Streaming for Apache Kafka (MSK) and self-managed Kafka event sources, enabling developers to define custom retry configurations and route failed messages to a Kafka topic as an on-failure destination. The update extends Kafka event source mapping (ESM) in Provisioned mode to support retry limits, time-bound retry windows, automatic discards of exceeded records, and per-message failure reporting to optimize retries. Configure these settings via the ESM API, AWS Console, or AWS CLI.

AWS Lambda lowers Kafka ESM costs with Provisioned mode

⚡ AWS announces enhancements to Lambda's Provisioned mode for Kafka event source mappings, enabling grouping of ESMs and higher density of event pollers to reduce costs by up to 90% for low-throughput workloads. Each Event Poller Unit (EPU) still provides 20 MB/s but now defaults to 10 pollers per EPU and supports shared capacity via the new PollerGroupName parameter. Changes are available today across AWS Commercial Regions and can be configured via API, CLI, Console, SDK, CloudFormation, or SAM.