All news with #aws trainium tag

AWS AI Factories: Dedicated High-Performance AI Infrastructure

🚀 AWS AI Factories are now available to deploy high-performance AWS AI infrastructure inside customer data centers, combining AWS Trainium, NVIDIA GPUs, low-latency networking, and optimized storage. The service integrates Amazon Bedrock and Amazon SageMaker to provide immediate access to foundation models without separate provider contracts. AWS manages procurement, setup, and operations while customers supply space and power, enabling isolated, sovereign deployments that accelerate AI initiatives.

CloudWatch Container Insights Supports Neuron UltraServers

🔍 Amazon CloudWatch Container Insights now supports Neuron UltraServers on Amazon EKS, enabling aggregated observability for multi-instance ML servers. The update adds a new UltraServer ID filter that presents consolidated metrics across all instances in a logical UltraServer group while retaining per-instance visibility. Available in all commercial AWS Regions and AWS GovCloud (US), this simplifies monitoring and troubleshooting for Trainium and Inferentia workloads.