Nvidia GTC 2026: What to expect at AI Burning Man
…To recap, Rubin packs up to 288 GB of HBM4 memory good for 22 TB/s of bandwidth and 35-50 petaFLOPS of dense NVFP4 performance depending on the use case. The…
Search
Related topics:
NVFP4
All sources
developer.nvidia.com
56
blogs.nvidia.com
27
wccftech.com
16
huggingface.co
7
tomshardware.com
4
igorslab.de
3
techpowerup.com
3
guru3d.com
2
xda-developers.com
2
amd.com
2
hardwareluxx.de
2
intel.com
1
Tracked topic
NVFP4
Live now
An NVFP4 quant of Qwen3.8 27B is being touted as the fastest available right now, based on user-perceived performance.
Live sources:
r/LocalLLaMA
NVIDIA Unleashes Dynamic MFG And Big GeForce Now Upgrades At GDC 2026
…Labs' FLUX.2 Klein text-to-image models that are quantized down to FP8 and NVFP4. These models reduce output quality in exchange for massive performance improvements, as you can see in…
Retail Archives
…a full-stack architecture built for speed, efficiency and scale: The Blackwell architecture features include: NVFP4 low-precision format for efficiency without loss of accuracy Fifth-generation NVIDIA NVLink that connects 72…
Banking Archives
…a full-stack architecture built for speed, efficiency and scale: The Blackwell architecture features include: NVFP4 low-precision format for efficiency without loss of accuracy Fifth-generation NVIDIA NVLink that connects 72…
Discussions and forums
Fastest NVFP4 quant of Qwen3.8 27B out there
Here's a brand new Blackwell-native, prefill-optimized 4-bit quant that runs 50% faster on compatible hardware than a Q4 quant of the same memory footprint. And it runs 4-7% faster than other NVFP4 quants as benchmarked …
366 t/s Qwen3.6 27B NVFP4 on v100s
These are single stream numbers Following on from my previous post about v100s (here) and inspired by this comment (here) I decided to work on kernels that allow for an extremely fast path for Nvfp4 weights on sm70 and a…
NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090.
Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It ran NInfer, a specia…
Qwen3.5 35B A3B uncensored heretic Native MTP Preserved is Out Now With the Full 785 MTPs Preserved and Retained, Available in Safetensors, GGUFs. NVFP4, NVFP4 GGUFs and GPTQ-Int4 Formats
Safetensors, llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved: https://huggingface.co/llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved GGUFs, llmfan46/Qwen3.5-35B-A3B-uncensored-here…
New official weights for Laguna S 2.1 FP8 & NVFP4 are now available
Poolside have updated the FP8 and NVFP4 checkpoints for Laguna S 2.1, increasing the default context size to 1 million, and updating the configs. Here's hoping they fixed the looping issue, this model has been great in m…
Genomics Archives
…a full-stack architecture built for speed, efficiency and scale: The Blackwell architecture features include: NVFP4 low-precision format for efficiency without loss of accuracy Fifth-generation NVIDIA NVLink that connects 72…
Inference Archives
…a full-stack architecture built for speed, efficiency and scale: The Blackwell architecture features include: NVFP4 low-precision format for efficiency without loss of accuracy Fifth-generation NVIDIA NVLink that connects 72…
Nemotron Archives
…a full-stack architecture built for speed, efficiency and scale: The Blackwell architecture features include: NVFP4 low-precision format for efficiency without loss of accuracy Fifth-generation NVIDIA NVLink that connects 72…
DFlash 추론 가속 디코딩으로 NVIDIA Blackwell에서 최대 15배 추론 성능 향상하기
…DFlash는 Blackwell의 15 PFLOPS 고밀도 NVFP4 연산에 더 많은 병렬 작업을 노출시키기 때문에 이 아키텍처에 매우 적합하며, 동일한 인터랙티비티 속도에서 최대 15배 더 많은 사용자를 동시에 서빙합니다. DFlash는 서로 다른 데이터셋에서도 EAGLE…
Smaller, faster, safer: running Kimi and GLM at scale
…We're expanding FP8 KV caches across more of the fleet, validating NVFP4 weights on Blackwell (NVIDIA’s GPU architecture), and working toward making integrity checks something we can leave on everywhere…
The Open Agentic AI World According To Nvidia
…At the show, Nvidia expanded its family of Nemotron 3 open models that it first introduced last year, including Nemotron 3 Ultra, which leverages the vendor’s NVFP4 format on the Blackwell…