< ciso
brief />
Tag Banner

All news with #google kubernetes engine tag

66 articles

Google Makes Sidecarless Ambient Networking Available on GKE

🚀 Google Cloud has announced the general availability of ambient networking for Google Kubernetes Engine (GKE), bringing a sidecar-less service mesh architecture into production. Networking duties move from individual application pods to shared per-node components and a managed control plane. The approach enables mTLS, authorization policies, and L4 and L7 telemetry with lower resource usage and simpler operations.
read more →

DynaPORT Moves to Google Cloud with AlloyDB and GKE

🚢 Tata Consultancy Services and one of India's largest port operators migrated the DynaPORT Terminal Operating System from an on-premises Oracle stack to Google Cloud. The team chose AlloyDB for PostgreSQL and GKE, converting over 1.2 million lines of PL/SQL with Database Migration Service. The platform went live in April 2026, with reported gains of up to 2x transactional throughput and roughly 50% lower database TCO.
read more →

Google Previews Single-Stack IPv6 on GKE for AI Workloads

🌐 Google Cloud has announced a preview of single-stack IPv6 on GKE, letting both nodes and pods run without private IPv4 addresses. The feature targets large AI deployments that are running out of address space and supports Cloud TPU v6e and CPU node pools, including Axion. With DNS64/NAT64, pods can still reach IPv4-only endpoints. Internal tests showed performance on par with IPv4.
read more →

Experimenting with ClusterNetworkPolicy in GKE

🔒 This post demonstrates using ClusterNetworkPolicy (CNP) in Google Kubernetes Engine (GKE) to enforce cluster-wide, multi-tier networking controls. It describes an experiment protecting an LLM workload (Gemma 4) running on TPU-backed GKE nodes and shows how CNP admin, network policy, and baseline tiers interact. The setup includes a custom VPC, Cloud NAT, GKE Dataplane V2 (eBPF), and namespace-scoped NetworkPolicies to allow only authorized clients while blocking metadata access.
read more →

Using VPC Flow Logs to Troubleshoot GKE Workloads

📘 VPC Flow Logs in Google Cloud annotates sampled network flows with GKE metadata so ephemeral pod IPs are attributed to workloads, namespaces, and services. This gives workload-level L3/L4 visibility without extra agents and complements in-cluster observability. Flow Analyzer in Network Intelligence Center and upgraded Observability Analytics buckets let you query, group, and visualize traffic by cluster, namespace, workload, pod, service, and zone. The post includes walkthroughs using Online Boutique to illustrate common troubleshooting cases.
read more →

GKE Dataplane V2 for high-density agentic AI

🔒 This post explains how GKE Dataplane V2 uses eBPF-powered identity mapping, label filtering, and metadata migration to support sub-second provisioning and extreme pod density for agentic AI workloads. It highlights Agent Sandbox and Agent Substrate on GKE as solutions for secure, lightweight isolation and state rehydration at large scale. The article outlines techniques to avoid the 65,536 identity limit and to maintain low-latency startup for thousands of sandboxes.
read more →

ZenteiQ boosts AI inference throughput with GKE

🧭 ZenteiQ, an AI startup from IISc, built sovereign scientific foundation models and a large batch synthetic data-generation pipeline. They used Google Kubernetes Engine (GKE) and GKE Inference Gateway with the open-source llm-d framework to route inference across vLLM accelerator pools, improving routing by using live queue depth and KV cache signals. This intelligent routing increased aggregate inference throughput 4.07x and raised daily token output from 1.47 billion to 5.97 billion per 1,000 accelerators, improving schedule predictability and dataset readiness for pre-training.
read more →

Wiz Runtime Sensor for GKE: Managed eBPF Runtime Guard

🔒 Google Cloud and Wiz announce the Wiz Runtime Sensor add-on for Google Kubernetes Engine (GKE), now in preview. The managed, first-party integration automates deployment, credential handling via Secret Manager, lifecycle updates, and fleet-wide enforcement to deliver eBPF-based runtime threat detection for Standard and Autopilot clusters. The sensor provides kernel-level observability with low CPU and fixed memory limits, supports proxyed egress, and auto-updates independently of cluster lifecycles. Platform teams can enable and enforce the add-on via gcloud, APIs, and organization policy.
read more →

AI21 Accelerates Model Training with AI Hypercomputer

🔧 AI21 Labs adopted Google Cloud AI Hypercomputer and Kueue on GKE to run foundation models like the Jamba family at scale. They pooled thousands of A3 and A3 Ultra GPU instances into a shared GKE cluster to maximize utilization and replaced manual capacity negotiation in Slack with automated scheduling. The change reduced high-priority job wait times from 72 hours to 12, cut manual scheduling interventions from 20 per week to zero, and lowered fragmentation.
read more →

GKE CPU Startup Boost for Faster Pod Starts

🚀 GKE introduces CPU startup boost in preview, integrated into the Vertical Pod Autoscaler (VPA), to temporarily elevate CPU allocation during container initialization and then in-place scale it back to steady-state levels without restarting containers. The feature leverages Kubernetes In-place Pod Resize (IPPR) and operates across admission, startup, and unboosting phases. It targets CPU-intensive startup workloads—such as Java JVMs, Node.js, and Python/AI microservices—so teams can avoid overprovisioning while reducing cold starts and costs. Available on GKE 1.36.0-gke.4447000+ for Standard and Autopilot clusters.
read more →

Networking architectures for AI inference model serving

🔒 This post compares two reference networking architectures for AI inference model serving: one tailored for Google Kubernetes Engine (GKE) and one for mixed or alternative backends. It explains a common control-plane pattern using Private Service Connect, optional Apigee, and Model Armor as a centralized entry point for secure, private inference calls. The GKE design adds a specialized GKE Inference Gateway, inference pools, and replica sets for GPU/TPU workloads. The multi-backend design uses a regional internal Application Load Balancer, a Cloud Run payload processor service extension to inject model headers, and Network Endpoint Groups to route to heterogeneous backends.
read more →

Google Named a Leader in 2026 Container Management

🚀 Google Cloud was named a Leader in the 2026 Gartner® Magic Quadrant™ for Container Management, ranking highest for Ability to Execute. The accompanying Gartner Critical Capabilities report placed Google Cloud first across all evaluated use cases, including AI training and inference. Google highlights recent GKE and Cloud Run innovations—like predictive latency boosts, rapid startup times, serverless GPU scale-to-zero, and Agent Substrate/Sandbox—to support enterprise and AI workloads at scale. The post invites users to try the open-source Agent projects and explore Cloud Run and GKE enhancements.
read more →

GKE agentic migration for safer cloud modernizations

🔧 Google Cloud released the open-source GKE agentic migration plugin to simplify migrations from AWS EKS to Google Kubernetes Engine. The tool combines LLM-driven translations with deterministic server-side validation and GitOps PR workflows to avoid direct changes to live clusters. It persists long-running migration state for multi-persona handoffs and produces runbooks for stateful transport, enabling human-in-the-loop approvals and safer, auditable migrations.
read more →

GKE Adds Native Prometheus Metrics for Autoscaling

🔔 Google Cloud announced built-in Prometheus metrics processing for GKE, enabling HPA to use PromQL queries directly via Google Managed Service for Prometheus. This removes the need for third-party adapters, reduces latency, and simplifies autoscaling configuration. The controller runs in the control plane and only deploys pods on nodes when PromQL metrics are actively requested, minimizing resource use. The feature is in preview with plans to add self-hosted Prometheus support before GA.
read more →

GKE Adds Native Scale-to-Zero Capabilities

🚀 GKE 1.37 introduces native scale-to-zero so workloads can fully scale down to zero replicas and stop consuming compute while idle. The feature uses HPA with the new AutoscalingMetric CRD and KEP-2021 support for minReplicas: 0 to wake workloads based on external signals such as Pub/Sub or Cloud Monitoring. Capacity buffers provide pooled warm capacity to eliminate cold-start latency and balance cost with instant responsiveness.
read more →

Kubernetes YAML can hand over a GCP organization

🛡️ When developers declare cloud resources via Kubernetes GitOps, controllers like Google Kubernetes Config Connector (KCC) act on their behalf using a platform service account. KCC authenticates with Google Cloud through a single service account that may have broad project, folder, or organization-level roles. If a user can create IAM-related resources in a namespace KCC watches, they can escalate privileges by having KCC apply bindings using its powerful account.
read more →

Global multi-cluster GKE inference for GPUs and TPUs

🧭 This post describes a layered routing architecture that makes globally scattered accelerator capacity behave like a single pool behind one entry point. The multi-cluster GKE Inference Gateway performs global traffic distribution and high availability while an LLM-d router applies memory-aware scheduling to maximize utilization across GPUs and TPUs. Benchmarks across three regions and 17,000 nodes showed near-linear throughput scaling and <1% routing overhead while maintaining ~99.9% success rates under heavy concurrency.
read more →

GKE Pod Snapshots: Faster Startup for AI Workloads

🚀 GKE Pod snapshots let you capture and restore a running Pod’s full state, including CPU and GPU memory, to dramatically reduce cold-start times for AI inference and sandboxed agent workloads. By persisting snapshots to high-throughput Cloud Storage, new replicas restore directly from a warmed state, cutting startup latency by up to 89% in benchmarks. This enables aggressive autoscaling, lowers idle GPU costs, and replaces complex custom caching solutions with a simple declarative CRD-driven workflow.
read more →

SeaVerse selects GKE Agent Sandbox for isolation

🎮 SeaVerse, a SeaArt gaming startup, built a platform for playable AI experiences and needed infrastructure that could run dynamic, multi-tenant sandboxes with low latency, strong isolation, and better observability. By adopting Google Kubernetes Engine (GKE) and GKE Agent Sandbox, SeaVerse achieved kernel-level isolation with microVMs and gVisor options, improved runtime visibility, and scaled sandbox allocations rapidly. The change reduced infrastructure costs by up to 60% while preserving a fast creator experience.
read more →

Agent Substrate now available on GKE clusters

🛡️ Agent Substrate is now available on Google Kubernetes Engine (GKE). This open-source agent execution runtime is engineered for high-density sandboxing, delivering sub-500ms resume times and hundreds of suspend/resume activations per second with native kernel and network isolation. Optimized for GKE but portable to any Kubernetes cluster, it supports hardware-isolated microVMs or gVisor sandboxes and integrates with existing agent frameworks like Hermes, Claude Code, and OpenClaw.
read more →