Pruning and Distilling LLMs Using NVIDIA TensorRT Model Optimizer | NVIDIA Technical Blog
… Learn more Large language models LLMs have set a high bar in natural language processing NLP tasks such as coding, reasoning, and math. …
Search
Tracked topic
LLMs
Large language models are machine learning models trained to predict and generate text and other language-based outputs.
Build Next-Gen Physical AI with Edge‑First LLMs for Autonomous Vehicles and Robotics | NVIDIA Technical Blog
… NVIDIA TensorRT Edge-LLM , a high-performance C++ inference runtime for LLMs and vision language models VLMs on embedded platforms, is designed to overcome these challenges. …
Post-Training Quantization of LLMs with NVIDIA NeMo and NVIDIA TensorRT Model Optimizer | NVIDIA Technical Blog
… Learn more As large language models LLMs are becoming even bigger, it is increasingly important to provide easy-to-use and efficient deployment paths because the cost of serving such LLMs is becoming higher. …
Winning a Kaggle Competition with Generative AI–Assisted Coding | NVIDIA Technical Blog
… To generate new ideas, we can either propose them or have LLMs generate them. There are many effective ways to encourage LLMs to generate ideas, such as: Ask LLMs to find and read research papers on the topic. Ask LLMs to read forums and publicly shared code on the topic. …
NVIDIA Blackwell Sets STAC-AI Record for LLM Inference in Finance | NVIDIA Technical Blog
… Learn more Large language models LLMs are revolutionizing the financial trading landscape by enabling sophisticated analysis of vast amounts of unstructured data to generate actionable trading insights. …
LLM Inference Benchmarking: How Much Does Your LLM Inference Cost? | NVIDIA Technical Blog
… He has contributed to production applications of LLMs covering RAG systems, optimization of inference servers, pretraining of LLMs from scratch, custom evaluation of LLMs, or quantization using FP8 formats. …
Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy | NVIDIA Technical Blog
Developer Tools & Techniques Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy Feb 09, 2026 By Lucas Liebenwein , Suyog Gupta and Laikh Tewari Discuss 0 Discuss 0 L T F R E NVIDIA TensorRT LLM enables developers to build high-performance inference engines for large language m… …
How Small Language Models Are Key to Scalable Agentic AI | NVIDIA Technical Blog
… The new role of LLMs in a heterogeneous AI architecture This doesn’t mean LLMs are obsolete. …
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron | NVIDIA Technical Blog
… These methods have achieved significant success more recently when applied to leading LLMs. …
Build a Retrieval-Augmented Generation (RAG) Agent with NVIDIA Nemotron | NVIDIA Technical Blog
… Agentic RAG goes a step further by leveraging autonomous systems integrated with LLMs and retrieval mechanisms. …