Visko and Google Cloud TPUs accelerate live world models
🚀 This technical deep dive describes how AI startup Visko partnered with Google Cloud TPU engineers to deploy Orbis, a continuously streaming Live World Model, onto Cloud TPUs in 30 days. The post explains why live, steerable video streams are far more latency-sensitive than offline clip generation and outlines the architectural optimizations used. It highlights a single-slice BF16 deployment combining JAX, torchax, and Pallas kernels to achieve 1.07x playback speed and practical guidance for startups scaling real-time multimodal inference.
