Search

Showing top 80 results for "Performance & optimization"

All sources blogs.nvidia.com 80

People also ask

How Did NVIDIA Double Blackwell Performance Through Continuous Software Optimizations to Lower Token Cost?

NVIDIA doubled Blackwell performance through continuous software optimization, refining kernels, compiler paths, and inference runtimes so the same hardware delivers significantly more useful AI throughput over time. Initial gpt-oss-120b performance on an NVIDIA DGX Blackwell B200 system with the NVIDIA TensorRT LLM library was market-leading, but NVIDIA’s teams and the community have significantly optimized TensorRT LLM for open-source large language models. The TensorRT LLM v1.0 release is a major breakthrough in making large AI models faster and more responsive for everyone. Through advance

Telecommunications Archives
 What Hardware-Software Innovations Power Blackwell’s Leadership?

Blackwell’s leadership comes from extreme hardware-software codesign. It’s a full-stack architecture built for speed, efficiency and scale: The Blackwell architecture features include: NVFP4 low-precision format for efficiency without loss of accuracy Fifth-generation NVIDIA NVLink that connects 72 Blackwell GPUs to act as one giant GPU NVLink Switch, which enables high concurrency through advanced tensor, expert and data parallel attention algorithms Annual hardware cadence plus continuous software optimization — NVIDIA has more than doubled Blackwell performance since launch using software

Telecommunications Archives