All news with #nvidia nemo tag

🚀 NVIDIA Nemotron 3.5 Lightning is now available on Amazon SageMaker JumpStart, enabling customers to deploy a high-throughput open model optimized for persistent agent workloads. The 30B-parameter hybrid MoE design activates 3B parameters per pass, delivering up to 4x throughput (~410 tokens/sec) and 30% faster task completion. It supports up to 1M-token context and can be post-trained and deployed across edge, on-premises, or cloud environments.

🔒 Falcon AIDR now integrates with NVIDIA NeMo Guardrails to provide programmable runtime protections for homegrown AI agents moving into production. The combined solution blocks prompt injection, redacts PII, defangs malicious domains, and moderates unwanted topics while preserving responsive, sub-100ms agent workflows. Teams can leverage 75+ built-in detectors or create custom policies to monitor in report-only mode and then progressively enforce blocks, redactions, encryptions, or transformations.