Speculative decoding made my local LLM actually usable
…Related Here's how I get the most out of my self-hosted LLM, especially when limited by VRAM Don't have an RTX 5090? No problem! Running a local LLM is…
Search
All sources
xda-developers.com
52
huggingface.co
42
developer.nvidia.com
8
intel.com
7
theregister.com
5
phoronix.com
3
arstechnica.com
2
semiwiki.com
2
appleinsider.com
2
404media.co
2
wccftech.com
2
amd.com
2
Tracked topic
LLMs
Large language models are machine learning models trained to predict and generate text and other language-based outputs.
Videos
More videos
Vector Search with LLMs - Computerphile
Nicholas Carlini - Black-hat LLMs | [un]prompted 2026
AgentMerge: Enhancing Battlefield Issue Management with LLMs | AI and Games Conference 2024
A Compilation of Robots Falling Down at the DARPA Robotics Challenge
DARPA Robotics Challenge 2013: A Woodstock for Robots | The New York Times
Top stories
Running Ollama on a 15W CPU sounded ridiculous until I got it working with decent results
…It's no good simply asking whether XDA covers PC hardware and LLMs, especially after querying what XDA is. The LLM will base its follow-up response on the forum, but that…
A Simple Calculation Can Stop AI From Lying About What It Doesn't Know
…This technique could help to fix one of the most pressing problems with using LLMs in serious contexts. It's one thing for an LLM to provide wrong facts for an English…
Paper page - IntentGrasp: A Comprehensive Benchmark for Intent Understanding
…Intent Understanding, Dataset, Benchmark, LLM, Evaluation, Intentional Fine-Tuning Abstract: Accurately understanding the intent behind speech, conversation, and writing is crucial to the development of helpful Large Language Model (LLM) assistants. We…
Discussions and forums
LLMs and Almost Good Code
LLMs and Almost Good Code
1
LLMs and Almost Good Code
LLMs and Almost Good Code
2
Using LLMs to secure source code
Using LLMs to secure source code
1
Measuring LLMs' ability to develop exploits
Measuring LLMs' ability to develop exploits
3
Measuring LLMs' ability to develop exploits
Measuring LLMs' ability to develop exploits
3
Paper page - FlashRT: Towards Computationally and Memory Efficient Red-Teaming for Prompt Injection and Knowledge Corruption
…AI-generated summary Long-context large language models (LLMs)-for example, Gemini-3.1-Pro and Qwen-3.5-are widely used to empower many real-world applications, such as retrieval-augmented…
Paper page - Hallucinations Undermine Trust; Metacognition is a Way Forward
…Multi-Agent Reinforced Self-Check for LLM Hallucination (2026) Mitigating LLM Hallucinations through Domain-Grounded Tiered Retrieval (2026) PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations (2026) Facet-Level Tracing…
I added one tool to my local LLM setup, and it finally stopped making things up
…It was quicker to set up than I expected, and it makes a real difference in the way my local LLM responds… The Brave Search MCP Letting local LLMs access real-time…
I automated my entire read-it-later workflow with a local LLM so every article I save gets summarized overnight
…Related I use local LLMs and self-hosted apps to manage my documents instead of relying on ChatGPT Not every LLM-powered task requires a ChatGPT subscription A workflow that changes how…
My local LLM can call Claude when it's stuck, and it changed everything about my local-first setup
…Local LLMs can use some help Local LLMs are not very good at handling highly complex tasks because they are running on limited hardware in the first place. Most consumer-grade models…
Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy | NVIDIA Technical Blog
Developer Tools & Techniques Automating Inference Optimizations with NVIDIA TensorRT LLM AutoDeploy Feb 09, 2026 By Lucas Liebenwein , Suyog Gupta and Laikh Tewari Discuss (0) Discuss (0) L T F R E NVIDIA…