Nvidia Nemotron 3.5 Lightning Runs Locally on a Single GPU
… The NVFP4 repository is approximately 21.6GB before runtime overhead and context-cache allocation are considered. …
Search
Related topics:
NVFP4
Tracked topic
NVFP4
Live now
An NVFP4 quant of Qwen3.8 27B is being touted as the fastest available right now, based on user-perceived performance.
Live sources:
r/LocalLLaMA