All news with #amazon msk tag

Amazon MSK Serverless Now Available in São Paulo Region

🚀 Amazon Web Services has made Amazon MSK Serverless generally available in the South America (São Paulo) region, enabling customers to connect Apache Kafka applications without managing cluster capacity. MSK Serverless automatically provisions and scales compute and storage resources on demand, letting teams run Kafka with reduced operational overhead. This expansion aligns São Paulo with AWS's global GA regions.

Amazon MSK Console and Public APIs for Kafka Topics

🔍 Amazon Managed Streaming for Apache Kafka (Amazon MSK) now exposes topic listings and detailed topic views directly in the MSK console and via three new public APIs. You can browse and search topics within a cluster, quickly review replication settings and partition counts, and drill into per-topic configuration and partition-level metrics without installing Kafka admin clients. The new ListTopics, DescribeTopic, and DescribeTopicPartitions APIs are available through the AWS CLI and SDKs; these features require MSK Provisioned clusters running Kafka 3.6+ and appropriate IAM permissions.

Amazon MSK Replicator expands to Hyderabad and Malaysia

🔁 Amazon Web Services has expanded MSK Replicator to the Asia Pacific (Hyderabad) and Asia Pacific (Malaysia) Regions, enabling customers to replicate streaming data between Amazon MSK clusters. MSK Replicator automates asynchronous replication and preserves Kafka metadata such as topic configurations, ACLs, and consumer offsets, while automatically scaling underlying resources. The feature simplifies failover and regional resilience and is available from the MSK console or CLI.

Amazon Managed Prometheus Collector Adds MSK Support

📈 The Amazon Managed Service for Prometheus collector now supports discovery and scraping of Prometheus metrics from Amazon Managed Streaming for Apache Kafka (MSK) clusters without deploying agents. The agentless collector can target metrics exposed via the JMX exporter and the Node exporter, covering host-level, JVM-level, and broker-specific telemetry. This simplifies open monitoring for MSK, improves availability and scalability, and is available in all commercial regions where the service is offered.

Amazon MSK Express Brokers Add Intelligent Rebalancing

⚡ Effective today, all new Amazon MSK Provisioned clusters with Express brokers support Intelligent Rebalancing at no additional cost. The feature automates partition balancing when clusters scale up or down, maximizing capacity utilization and removing the need for manual or third-party partition management. AWS reports Intelligent Rebalancing runs up to 180× faster than Standard brokers and scales brokers without impacting client availability.

AWS Serverless MCP Server Adds ESM Tools for Lambda

🔧 The AWS Serverless Model Context Protocol (MCP) Server now includes specialized tools to configure and manage AWS Lambda event source mappings (ESM), combining AI assistance with ESM expertise. The new toolset—comprising the ESM guidance tool, the ESM optimization tool, and an ESM Kafka troubleshooting tool—translates high-level throughput, latency, and reliability requirements into concrete ESM configurations and generates optimized AWS SAM templates. It also validates VPC network topology for VPC-based event sources and diagnoses common ESM issues to streamline setup, tuning, and troubleshooting workflows.

Amazon MSK Adds Apache Kafka 4.1 with Queues Preview

📣 Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports Apache Kafka 4.1, introducing Queues as a preview feature, a new Streams Rebalance Protocol in early access, and Eligible Leader Replicas (ELR) enabled by default. These features target improved parallelism, optimized Kafka Streams task rebalancing, and stronger availability. To adopt 4.1, select 4.1.x when creating a cluster or perform an in-place rolling update; MSK orchestrates broker restarts to maintain availability. Kafka 4.1 support is available today across all AWS regions where MSK is offered.

Amazon MSK Connect Expands to Ten More AWS Regions

🚀 Amazon MSK Connect is now available in ten additional AWS Regions — Jakarta, Hong Kong, Osaka, Melbourne, Milan, Zurich, Bahrain, UAE, Cape Town, and Tel Aviv. MSK Connect provides fully managed Kafka Connect clusters for deploying, monitoring, and scaling connectors to move data between Apache Kafka/Amazon MSK and external systems without provisioning infrastructure. The service supports both managed and self-managed Kafka clusters and is accessible via the MSK console and CLI.

Amazon MSK Connect Expands to Five More AWS Regions

📢 Amazon has expanded MSK Connect availability to five additional AWS Regions: Asia Pacific (Thailand), Asia Pacific (Taipei), Mexico (Central), Canada West (Calgary), and Europe (Spain). MSK Connect provides fully managed Kafka Connect clusters to deploy, monitor, and scale connectors that move data between Apache Kafka/Amazon MSK and external systems without provisioning infrastructure. Connectors scale automatically and are compatible with Kafka Connect, supporting both MSK-managed and self-managed Kafka clusters. Customers can get started from the Amazon MSK console or the AWS CLI and pay only for the resources they use.

Amazon MSK Expands Express Brokers to 8 Additional Regions

🚀 Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports Express brokers in eight additional AWS Regions: AWS GovCloud (US-West), AWS GovCloud (US-East), Jakarta, Melbourne, Osaka, Zurich, Tel Aviv, and Hong Kong. Express brokers are a Provisioned broker type that deliver up to 3x more throughput per broker, scale up to 20x faster, and reduce recovery time by 90% versus standard Apache Kafka brokers. They arrive pre-configured with Kafka best practices, support all Kafka APIs, and maintain low-latency performance so existing client applications require no changes.

Amazon MSK Connect Now Available in Malaysia Region

🚀 Amazon has launched MSK Connect in the Asia Pacific (Malaysia) Region, offering a fully managed service for running Kafka Connect clusters alongside Amazon MSK. The service simplifies deploying, monitoring, and scaling connectors that move data between Apache Kafka and external systems, without provisioning infrastructure. It supports both Amazon MSK-managed and self-managed Kafka clusters and can be used via the console or CLI.