NVIDIA Rubin GPU 아키텍처 심층 분석: 에이전틱 AI 시대를 이끄는 힘
…정밀도 유연성이 확장된 향상된 텐서 코어 와 새로운 HBM4 메모리 서브시스템, 그리고 최대 50 페타플롭스의 NVFP4 성능을 발휘하는 3세대 트랜스포머 엔진이 유기적으로 결합되어 에이전틱 워크로드를 획기적으로 가속합니다. 이 글에서는 NVIDIA Rubin GPU와…
Search
Related topics:
NVFP4
All sources
developer.nvidia.com
56
blogs.nvidia.com
27
wccftech.com
16
huggingface.co
7
tomshardware.com
4
igorslab.de
3
techpowerup.com
3
guru3d.com
2
xda-developers.com
2
amd.com
2
hardwareluxx.de
2
intel.com
1
Tracked topic
NVFP4
Live now
An NVFP4 quant of Qwen3.8 27B is being touted as the fastest available right now, based on user-perceived performance.
Live sources:
r/LocalLLaMA
NVIDIA Nemotron 3 Super 공개 — 에이전틱 추론을 위한 오픈 하이브리드 Mamba-Transformer MoE
…네이티브 NVFP4 사전 학습 : NVIDIA Blackwell에 최적화되어, 메모리 요구사항은 크게 낮추면서 NVIDIA B200 추론 속도를 NVIDIA H100의 FP8 대비 4배까지 끌어올리고, 정확도도 함께 유지합니다. 다환경 강화 학습(RL) : NVIDIA NeMo Gym 과…
AMD Instinct MI355X bei MLPerf Training 6.0: Fortschritte und Skalier…
…AMD nutzt MXFP4, NVIDIA NVFP4. Beide Formate reduzieren die numerische Genauigkeit, um mehr Rechenoperationen pro Takt auszuführen und den Speicherbedarf zu senken. Entscheidend ist, dass das Modell dennoch das von MLPerf vorgegebene…
I'm running a 284-billion-parameter model across two machines, and it finally matches the cloud
…As well, the KV cache moves to NVFP4, fitting roughly 1.27 million tokens into about 8.5 GiB per rank, so the full context window costs far less memory than a…
Discussions and forums
Fastest NVFP4 quant of Qwen3.8 27B out there
Here's a brand new Blackwell-native, prefill-optimized 4-bit quant that runs 50% faster on compatible hardware than a Q4 quant of the same memory footprint. And it runs 4-7% faster than other NVFP4 quants as benchmarked …
366 t/s Qwen3.6 27B NVFP4 on v100s
These are single stream numbers Following on from my previous post about v100s (here) and inspired by this comment (here) I decided to work on kernels that allow for an extremely fast path for Nvfp4 weights on sm70 and a…
NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090.
Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It ran NInfer, a specia…
Qwen3.5 35B A3B uncensored heretic Native MTP Preserved is Out Now With the Full 785 MTPs Preserved and Retained, Available in Safetensors, GGUFs. NVFP4, NVFP4 GGUFs and GPTQ-Int4 Formats
Safetensors, llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved: https://huggingface.co/llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved GGUFs, llmfan46/Qwen3.5-35B-A3B-uncensored-here…
New official weights for Laguna S 2.1 FP8 & NVFP4 are now available
Poolside have updated the FP8 and NVFP4 checkpoints for Laguna S 2.1, increasing the default context size to 1 million, and updating the configs. Here's hoping they fixed the looping issue, this model has been great in m…
Bringing AI Closer to the Edge and On-Device with Gemma 4 | NVIDIA Technical Blog
…From Blackwell, with NVFP4 quantized checkpoints coming soon, to Jetson platforms, developers can quickly get started deploying these high-accuracy multimodal models, with the flexibility to meet their speed, security, and cost…
Intel® oneAPI Deep Neural Network Library Release Notes and System...
…Introduced support for NVFP4 quantization scheme. The changes include support for fp8_e4m3 grouped scales and dynamic quantization support for destination tensor with NVFP4-specific formula for scales computation. Introduced support for…
NVIDIA Levels Up Local AI Agents Across RTX PCs and DGX Spark
…The updates deliver 2.6x performance on DGX Spark compared with the previously available NVFP4 checkpoints from Unsloth, and include kernel improvements as well as mixed precision, and CUDA Graph support for…
SK hynix and TetraMem collaborate on experimental chip to bolster energy efficiency for edge AI devices — memristor-based in-memory SoC research leaves performance questions up in the air
…Conceptually, the approach is somewhat analogous to Nvidia's NVFP4 philosophy, in that both seek to achieve higher effective precision from low-precision hardware. However, the implementations are fundamentally different: NVFP4 relies…
Inside NVIDIA Rubin GPU Architecture: Powering the Era of Agentic AI | NVIDIA Technical Blog
…Enhanced Tensor Cores with expanded precision flexibility, a new HBM4 memory subsystem, and the third-generation Transformer Engine—delivering up to 50 petaflops of NVFP4 performance—work together to accelerate agentic workloads…
Building NVIDIA Nemotron 3 Agents for Reasoning, Multimodal RAG, Voice, and Safety | NVIDIA Technical Blog
…Nemotron 3 Super employs a hybrid Mamba-Transformer MoE architecture with NVFP4 precision on Blackwell GPUs, achieving high throughput and efficiency for multi-agent tasks, while Nemotron 3 Content Safety delivers low…