In addition to Muon, NVIDIA also supports many other optimizers for the research community to explore, including: The ultimate form of orthogonalized optimizer MOP (Momentum Orthogonalized by Polar decomposition) An advanced SOAP variant that updates eigen basis per step with eigen decomposition plus KL correction in REKLS
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical Blog…routing, distributed caching, and Planner decisions. Replay on a virtual clock Discrete-event simulation, or DES, gives DynoSim a virtual clock and an event queue. Components do not wait in real time…
…D3D12 Opacity Micromaps DirectX Raytracing (DXR) now supports Opacity Micromaps (OMMs), enabling hardware to handle alpha-tested geometry more efficiently than relying only on costly any-hit shader invocations. D3D12 Shader Execution…
…supports startups worldwide with go-to-market support, expertise, and technology. Startups get access to training through NVIDIA’s Deep Learning Institute, preferred pricing on hardware through our global network of distributors…
…These capabilities will also be supported for the NVIDIA Vera Rubin platform, including for NVIDIA Rubin NVL8. This post demonstrates how Mission Control, Slurm, and NVIDIA Run:ai turn advanced GPU architecture…
…TII introduced advanced engineering solutions for seamless two-repository support, including the ParallelHybridLayer, specialized layer allocation logic, weight mapping for Hugging Face checkpoint conversion, and non-learnable maximal update parametrization (P) multipliers…
…It provides a simplified yet physically representative model for resolving local neutron transport and flux distributions prior to subsequent assembly-level and full-core analyses. A typical reactor core contains on the…
…The Yocto Project Support NVIDIA now officially supports Yocto Project , making it easier for developers to build custom embedded Linux distributions for Jetson platforms. Full-stack, NVIDIA-validated recipes and reference images…
…Yocto Project on Jetson NVIDIA’s official Yocto Project support on Jetson enables custom, reproducible Linux distributions to ensure optimized performance and deterministic builds for edge AI deployments. Partner Supported Linux NVIDIA…
…an extension of DeepStream NvTracker, enables distributed, real-time 3D tracking across networks of cameras. It works seamlessly with both 2D and 3D detectors, supporting a wide range of use cases. DeepStream…
…What is AA-AgentPerf? AA-AgentPerf is a hardware benchmark created by Artificial Analysis that measures the number of concurrent AI agents an inference system can support while meeting predefined, model-specific…