In addition to Muon, NVIDIA also supports many other optimizers for the research community to explore, including: The ultimate form of orthogonalized optimizer MOP (Momentum Orthogonalized by Polar decomposition) An advanced SOAP variant that updates eigen basis per step with eigen decomposition plus KL correction in REKLS
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical Blog…As AI factories scale to support increasingly distributed and autonomous workloads, network communication becomes a critical attack surface. DOCA Flow enables security policies to be enforced directly within the infrastructure layer, preventing…
…community contributions expand it regularly. Best Practice 6: Design models with deployment in mind. When choosing architectures, evaluate the deployment cost of exotic operations early. Sometimes a functionally equivalent but better-supported…
…Connect With the Community Engage with the Isaac Sim community by joining the NVIDIA forum. Find answers for troubleshooting and post your own questions. Extend Isaac Sim Workflows NVIDIA Cosmos NVIDIA Cosmos…
…Community Support Jetson AI Lab Jetson AI Lab is an interactive platform for learning and experimenting with AI on NVIDIA Jetson, offering hands-on projects, tutorials, and tools tailored for edge AI…
…It supports open source inference engines including SGLang, TensorRT™ LLM, and vLLM and simplifies the complexities of distributed serving by disaggregating the various phases of inference across different GPUs, intelligently routing requests…
…This collaboration will boost GPU efficiency, eliminate context-switching for smoother gameplay, and provide a unified workflow for the broader development community. Building on last summer’s preview of Cooperative Vector support…
…This optimization fuses computation and communication operations into a single kernel to normalize query and key together. The kernel can better overlap computation and communication, reducing kernel launch and memory read/write…
…GPUs, CPUs, DPUs, and internode communication. Scale AI Applications to the Data Center and Cloud with NVIDIA Nsight Systems GTC Demo Video Feature Spotlight on Python support in Nsight Developer Tools Optimize…
…interprocess communication, and developer tools for debugging and profiling. Requires NVIDIA DRIVE AGX™ SDK Developer Program membership Benefits Programmability Enables a smooth transition from cloud or workstation to the SoC Supports NVIDIA…
…Developers across the AI community have contributed to Dynamo and broadened its capabilities. Mooncake and Alibaba extended the Dynamo AIConfigurator with SGLang support; Microsoft tested and hardened Dynamo on Azure Kubernetes Service…