AWS Neuron 2.31.0 adds NKI 0.5.0 and UltraServer
๐ AWS released Neuron 2.31.0, introducing NKI 0.5.0 with MX FP8 scale dtype, tensor indirection for indexed access patterns, and zero-cost NkiTensor view APIs. The release also brings the Neuron UltraServer Operator for Amazon EKS in public beta to automate UltraServer discovery and workload claims for Trainium UltraServer workloads. The Neuron Compiler now uses a redesigned codegen backend enabled by default on Trn2 and Trn3 for improved performance, while Runtime and Explorer add usability and debugging improvements.
