Boosting MoE Training Throughput with Advanced Fusion Kernels | NVIDIA Technical Blog
… In these low precision recipes, the activation function is followed by quantization and transpose for the narrow precision GEMM operation. …
Search
Mastering Agentic Techniques: AI Agent Customization | NVIDIA Technical Blog
…Parameter-efficient fine-tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA) and Quantized Low-Rank Adaptation (QLoRA), describe a type of update mechanism that can be used with SFT to freeze…
Extract More Kernel Performance with NVIDIA CompileIQ Auto-Tuning | NVIDIA Technical Blog
… To get the best value from CompileIQ, you need to start with reasonably high-performing code, which then enables the final compiler-heuristics tweaks to take you to maximum performance. …
NVIDIA Video Codec SDK 13.1: Zero-Copy Transcode, AV1 B-Frames, and Frame-Accurate Seek | NVIDIA Technical Blog
… For every 16×16 block, the decoder exposes the luma quantization parameter QP , the coding unit type Intra, Inter, Skip, or PCM , and up to two motion vectors forward and backward , all extracted as a natural byproduct of hardware decode with no additional CPU overhead. …