I finally stopped forcing local LLMs and switched back to cloud AI
…Plus, with local LLMs, you also lose the entire ecosystem you get with cloud-based AI providers. Related My local LLM can call Claude when it's stuck, and it changed everything…
Search
Related topics:
LLMs
Tracked topic
LLMs
Large language models are machine learning models trained to predict and generate text and other language-based outputs.
Live now
Linux 7.3 Network Changes Merged But Developers "Completely Overwhelmed" Due To AI/LLMs
Top stories
Most people use Ollama or llama.cpp for local LLMs, but these are the tools I switch to when it gets serious
…MLC-LLM and ExLlamaV3 target specific hardware problems Phones, browsers, and consumer GPUs don't all want the same runtime MLC-LLM is built around machine-learning compilation and deployment across a…
Your old GPU can still run big LLMs – you just need the right tweaks
…Related 7 things I wish I knew when I started self-hosting LLMs I've been self-hosting LLMs for quite a while now, and these are all of the things I…
I stopped trying to replace my cloud LLMs, and local models finally made sense
…Related Claude Code with a local LLM running offline is the hybrid setup I didn't know I needed Local LLMs are great, when you know what tasks suit them best The…
After a year of self-hosting LLMs, I realized the real bottleneck isn’t the GPU
…Sign in to your XDA account For the past year, I’ve been running my own local LLM setup, hoping it would make my work faster and more efficient. And in many…
I thought I needed a GPU for local LLMs until I tried this lean model
…Sign in to your XDA account When it comes to local LLMs, we have been told that if you aren’t packing a high-end GPU with a massive pool of VRAM…
I’d do these 5 things differently if I started self-hosting LLMs today
…Sign in to your XDA account I’ve been self-hosting LLMs for many months now, and the journey has been a wild mix of "aha!" moments and late-night troubleshooting sessions…
I almost upgraded my GPU to run larger local LLMs, but this 8B model proved I didn't have to
…When I had the PC built I didn't even know local LLMs were a thing. I just wanted something that would let me play my favorite games and use video editing…
AMD just dropped a compact AI workstation that makes discrete GPUs look outdated for running LLMs
…So, yes, we're talking super-large LLMs. Related I finally found a local LLM I want to use every day (and it's not for coding) Local AI that actually fits…
I built my own Googlebook with a Raspberry Pi, local LLMs, and old hardware
…Related I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead There's no point in relying on AI tools when my local LLMs…