NVIDIA Cosmos 3로 피지컬 AI 추론·월드·액션 모델 개발하기
…Cosmos 3 NIM은 BF16, FP8, NVFP4 양자화 체크포인트 선택을 지원합니다. NVFP4 양자화는 모델의 수치 정밀도를 BF16에서 4비트 부동소수점으로 낮춰 최대 2배의 추론 속도 향상을 달성합니다. vLLM: 연속 배칭(continuous batching), 페이지드 어텐션…
Search
Related topics:
NVFP4
All sources
developer.nvidia.com
56
blogs.nvidia.com
27
wccftech.com
16
huggingface.co
7
tomshardware.com
4
igorslab.de
3
techpowerup.com
3
guru3d.com
2
xda-developers.com
2
amd.com
2
hardwareluxx.de
2
intel.com
1
Tracked topic
NVFP4
Live now
An NVFP4 quant of Qwen3.8 27B is being touted as the fastest available right now, based on user-perceived performance.
Live sources:
r/LocalLLaMA
Paper page - Wan-Streamer v0.2: Higher Resolution, Same Latency
…An NVFP4 Parallel Infrastructure for Long Video Generation (2026) DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Model (2026) Preserving Speech-to-Text LLM Capabilities in Speech-to…
How NVIDIA Extreme Hardware-Software Co-Design Delivered a Large Inference Boost for Sarvam AI’s Sovereign Models | NVIDIA Technical Blog
…That was combined with the powerful compute capabilities of Blackwell, along with NVFP4 weight quantization, for an additional 2x speedup, with an even bigger performance gain of 2.8x seen at higher…
Ollama is supercharged by MLX's unified memory use on Apple Silicon
…There's also support for Nvidia's NVFP4 format, which can maintain model accuracy while also reducing the memory bandwidth. High-spec only To end users who work with LLMs…
Discussions and forums
Fastest NVFP4 quant of Qwen3.8 27B out there
Here's a brand new Blackwell-native, prefill-optimized 4-bit quant that runs 50% faster on compatible hardware than a Q4 quant of the same memory footprint. And it runs 4-7% faster than other NVFP4 quants as benchmarked …
366 t/s Qwen3.6 27B NVFP4 on v100s
These are single stream numbers Following on from my previous post about v100s (here) and inspired by this comment (here) I decided to work on kernels that allow for an extremely fast path for Nvfp4 weights on sm70 and a…
NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090.
Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It ran NInfer, a specia…
Qwen3.5 35B A3B uncensored heretic Native MTP Preserved is Out Now With the Full 785 MTPs Preserved and Retained, Available in Safetensors, GGUFs. NVFP4, NVFP4 GGUFs and GPTQ-Int4 Formats
Safetensors, llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved: https://huggingface.co/llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved GGUFs, llmfan46/Qwen3.5-35B-A3B-uncensored-here…
New official weights for Laguna S 2.1 FP8 & NVFP4 are now available
Poolside have updated the FP8 and NVFP4 checkpoints for Laguna S 2.1, increasing the default context size to 1 million, and updating the configs. Here's hoping they fixed the looping issue, this model has been great in m…
TDN72 statt NVL72: Tensordynes Napier greift Nvidia mit Logarithmen an - Golem.de
…Nicht nur den Namen übernimmt Tensordyne, das Startup will auch Nvidias eigenes Microscalingformat NVFP4 unterstützten – neben gängigen 8- und 16-Bit-Datentypen. Dabei packt Tensordyne allerdings wesentlich dichter als der Branchenführer: 72…
NVIDIA's Nemotron 3 Super Tops The Open-Source AI Model Chart, Beating DeepSeek & GPT-OSS
…Native NVFP4 pretraining optimized for NVIDIA Blackwell, significantly cutting memory requirements and speeding up inference by 4x on NVIDIA B200 compared to FP8 on NVIDIA H100, while maintaining accuracy. Multi-environment reinforcement…
AMD MI455X and Helios: 432GB HBM4, 72-GPU Racks, and a Real Answer to Vera Rubin
…AMD’s FP4 is OCP MXFP4; NVIDIA’s is NVFP4. They are different recipes: NVFP4 applies a fractional FP8 scale to every 16-element block plus a tensor-level scale on top…
GIGABYTE Pushes Into The AI Assistant Race With GiMATE, Powering Three New AORUS And AERO Laptops Built Around RTX 50 Series GPUs
…The new GIGABYTE laptop lineup includes three models that ship with GiMATE, leveraging NVIDIA NVFP4 quantization to improve generative AI efficiency on RTX 50 series laptop GPUs. The new flagship laptop model…
NVIDIA DGX Spark and DGX Station Power the Latest Open-Source and Frontier Models From the Desktop
…The NVIDIA Blackwell architecture powering DGX Spark includes the NVFP4 data format, which enables AI models to be compressed by up to 70% and boosts performance without losing intelligence. NVIDIA’s collaborations…
Paper page - Rethinking Shrinkage Bias in LLM FP4 Pretraining: Geometric Origin, Systemic Impact, and UFP4 Recipe
…As far as I can tell, NVIDIA’s current stack is pretty much all-in on NVFP4, which is also reflected in the recent Transformer Engine updates. For Blackwell, Rubin, and even…