I tested 3 local LLMs on my RTX 4070 Ti for real work — only one earned a permanent spot
…Related 7 things I wish I knew when I started self-hosting LLMs I've been self-hosting LLMs for quite a while now, and these are all of the things I…
Search
Related topics:
LLMs
Tracked topic
LLMs
Large language models are machine learning models trained to predict and generate text and other language-based outputs.
Live now
Linux 7.3 Network Changes Merged But Developers "Completely Overwhelmed" Due To AI/LLMs
Top stories
I connected my Docker server to local LLMs, and now my self-hosting workstation manages itself
…For the uninitiated, Model Context Protocol servers hook LLM providers and runtime environments to external services that don’t natively support AI models, and they do so by translating typical LLM requests…
Gemma 4 E2B proves Raspberry Pi-sized LLMs don't have to be terrible anymore
…Unfortunately, LLMs with the right reasoning capabilities for real-life tasks can typically only be run on the cloud. If you’re anything like me, you’re probably not too fond of…
One tiny change made my local LLMs more useful than ChatGPT for real work
…Related I use local LLMs and self-hosted apps to manage my documents instead of relying on ChatGPT Not every LLM-powered task requires a ChatGPT subscription RAG makes my LLMs more…
I stopped uploading my notes to ChatGPT and NotebookLM after setting up my local LLMs
…Instead, I use locally-deployed LLMs to handle all inference tasks for my note-taking needs. With the right collection of FOSS applications, embedding models, and good ol’ LLMs, I haven’t…
Ollama is the easiest way to start local LLMs, but these 6 alternatives are also worth trying
…See at Github Related I tried this open-source platform to self-host LLMs, and it’s faster than I expected Self-hosting LLMs is faster than you think Jan A polished…
Two days without internet taught me why local LLMs are worth the setup
…Related 7 things I wish I knew when I started self-hosting LLMs I've been self-hosting LLMs for quite a while now, and these are all of the things I…
Instead of Claude and Anthropic models, I use my local LLMs for coding (and not vibe-coding, mind you)
…Related I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead There's no point in relying on AI tools when my local LLMs…
I tried caring about ChatGPT and Claude, but I still haven't found a real need for LLMs
…Related I run local LLMs daily, but I'll never trust them for these tasks Your local LLM is great, but it'll never compare to a cloud model. I've used…
I replaced NotebookLM with this free tool that uses my local LLMs
…That said, I’ve spent the last couple of months building entirely local LLM pipelines using old hardware, so I wanted to see if I could find something that could replace NotebookLM…