Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical Blog
… What other optimizers does NVIDIA support for research? …
Search
People also ask
What other optimizers does NVIDIA support for research?
In addition to Muon, NVIDIA also supports many other optimizers for the research community to explore, including: The ultimate form of orthogonalized optimizer MOP (Momentum Orthogonalized by Polar decomposition) An advanced SOAP variant that updates eigen basis per step with eigen decomposition plus KL correction in REKLS
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical BlogAccelerated X-Ray Analysis for Nanoscale Imaging (XANI) of Novel Materials | NVIDIA Technical Blog
… Distributed computation with cuPyNumeric cuPyNumeric serves as the distribution engine for XANI by partitioning arrays across a cluster’s aggregate memory. In addition to providing NumPy and SciPy APIs, it serves as a library for large-scale distribution of NumPy-based applications. …
Enhancing Distributed Inference Performance with the NVIDIA Inference Transfer Library | NVIDIA Technical Blog
… NIXL will internally pass that information to each relevant backend that supports that memory type. …
DRIVE Ecosystem Thor Vendor
… Where NVIDIA is the SW Contact, the DriveOS version shows the version where the sensor support is introduced. The "+" at the end of the NVIDIA DriveOS™ version indicates that the specific module/device is supported in later minor releases. …
2 sources covering this — show 1 more
NVIDIA Megatron Core
… Learn more about resiliency features supported in NVIDIA Resiliency Extension . …
DRIVE AGX Autonomous Vehicle Development Platform
… Support Ask questions and get answers in our developer forum.
Ethernet drivers and acceleration software | NVIDIA
The NVIDIA® Ethernet drivers, protocol software and tools are supported by respective major OS Vendors and Distributions Inbox or by NVIDIA where noted. NVIDIA also supports all major processor architectures. …
Building Custom Atomistic Simulation Workflows for Chemistry and Materials Science with NVIDIA ALCHEMI Toolkit | NVIDIA Technical Blog
… This supports discovery to scale, making industrial-scale simulations accessible through familiar interfaces. …
Deploy Agentic-Ready AI at the Edge with Memory Efficiency in NVIDIA JetPack 7.2 | NVIDIA Technical Blog
… This post introduces new JetPack 7.2 release features and capabilities, which also include: NVIDIA Multi-Instance GPU MIG support on NVIDIA Jetson Thor for deterministic multiworkload execution Official Yocto Project support for custom Linux distributions that can further improve system efficiency … …