Tracked topic
…The two figures also use different formats, AMD's MXFP4 against Nvidia's NVFP4, so they are not measuring identical arithmetic. This might, however, be indicative of a very real situation that…
…Now, the RTX 5090D does have NVFP4, which should offer better performance, but for FP16 AI tasks, Intel's Arc Pro GPUs are showcasing very strong performance. One thing to note is…
…The company today showcased the underpinning of an accelerator capable of delivering 50 PetaFLOPS of compute power at sparse NVFP4 operations. In its full configuration, NVIDIA's "Rubin" GPU includes up to…
…An NVFP4 Parallel Infrastructure for Long Video Generation (2026) SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer (2026) Long-Horizon Streaming Video Generation via Hybrid Attention with Decoupled…
Here's a brand new Blackwell-native, prefill-optimized 4-bit quant that runs 50% faster on compatible hardware than a Q4 quant of the same memory footprint. And it runs 4-7% faster than other NVFP4 quants as benchmarked …
These are single stream numbers Following on from my previous post about v100s (here) and inspired by this comment (here) I decided to work on kernels that allow for an extremely fast path for Nvfp4 weights on sm70 and a…
Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It ran NInfer, a specia…
Safetensors, llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved: https://huggingface.co/llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved GGUFs, llmfan46/Qwen3.5-35B-A3B-uncensored-here…
Poolside have updated the FP8 and NVFP4 checkpoints for Laguna S 2.1, increasing the default context size to 1 million, and updating the configs. Here's hoping they fixed the looping issue, this model has been great in m…
…数量的特定 MLPerf closed 配置。在此背景下，成本、功耗、网络组件、服务器价格和软件许可并不自动可比。所使用的数值格式也不同。AMD 使用 MXFP4，NVIDIA 使用 NVFP4。两种格式都通过降低数值精度来实现每个周期更多运算并减少内存需求。关键在于，模型仍然达到了 MLPerf 规定的质量目标。因此，这些结果首先说明一件事：在这两个定义明确的训练任务中，AMD 已不再从根本上落后于 NVIDIA 的 Blackwell 平台。是否也适用于其他模型和软件环境，无法由此推导…
…This is enabled by deep co-design across NVIDIA Blackwell, NVLink™, and NVLink Switch for scale-out; NVFP4 for low-precision accuracy; and NVIDIA Dynamo and TensorRT™ LLM for speed and flexibility…
…Die Hardware von Tensordyne unterstützt die Datenformate NVFP4, FP8 und FP16 und in diesen Datenformaten werden die Daten im Speicher auch abgelegt. Die Berechnung in den 16 Kernen pro Chip findet dann…
…state-of-the-art audio-video model, released earlier this month, now has support for NVFP4 and FP8 distilled models, accelerating performance by 2.1x. Learn more about Lightricks’ LTX 2.3…
…Cosmos 3 NIM supports selecting BF16, FP8, or NVFP4 quantized checkpoints. The NVFP4 quantization reduces the model’s numerical precision from BF16 to 4-bit floating point, achieving up to 2x inference…
…60% faster in the same NVL72 configuration thanks to their higher AI compute density with NVFP4. The Blackwell architecture also scaled to deliver the latest cluster in MLPerf Training, comprising 8192 GPUs…