I replaced my local LLM with a model half its size and got better results — And it wasn't about the parameters
xda-developers.com
Search
Related topics:
LLMs
Top stories
I fine-tuned a 7B model to write my Home Assistant automations, and it actually works
…In my spare time, you’ll probably find me playing Counter-Strike or VALORANT, and you can reach out to me at adam@xda-developers.com , on Twitter as @AdamConwayIE , on Instagram…
I’d do these 5 things differently if I started self-hosting LLMs today
…Sign in to your XDA account I’ve been self-hosting LLMs for many months now, and the journey has been a wild mix of "aha!" moments and late-night troubleshooting sessions…
I talk to Perplexity Computer all day, and it's finally what AI assistants promised to be
xda-developers.com
I added a second GPU just for local AI workloads, and it cost less than upgrading my main one
…Sign in to your XDA account After years of using ChatGPT and Claude , I'm finally starting to dabble in local LLMs. I'm not replacing cloud AI yet, but running Qwen2…
I used Claude Code with a local LLM on Ollama, and it’s surprisingly capable for something that's free
xda-developers.com
My homelab needed a lightweight dashboard, so I had Claude and a local LLM race to build it
xda-developers.com
Local LLMs are actually good now, and I wasted months not realizing it
…Sign in to your XDA account There's a version of local LLMs that lives in my head from how they were a couple of years ago. That they’re slow, clunky…
I used my local LLM to rebuild my workflow from scratch, and it was better than I expected
xda-developers.com
I built a local AI stack with 5 Docker containers, and now I'll never pay for ChatGPT again
xda-developers.com