… Related 5 self-hosted LLMs I use for specific tasks My customized, self-hosted AI workflow A practical AI workflow that runs fully locally This setup changed how I approach productivity. …
… But for the rest of my self-hosted app stack, I’ve deployed a Gemma-4-26B-A4B instance on my GTX 1080. …
… As someone who loves self-hosting , jumping between my private tools and cloud-based AI felt clunky. …
… When you’ve got no prior experience in self-hosting, it’s hard not to see the convenience in relying on cloud models. After all, you have to manage everything yourself, all while relying on low-parameter models. …
… Self-hosted applications on a local server spare me from the OS problem, without the privacy-intrusive aspects of their cloud-based counterparts. …
… Nextcloud and Immich made self-hosting worth it My self-hosting journey has led me to install a few different services I love, but Nextcloud and Immich alone have made the trouble of learning about self-hosting worth it. …
… Once you venture past the 20B mark, the reasoning capabilities of self-hosted models skyrocket to the point where they’re good enough to replace their cloud counterparts for coding workloads. …
… If you’re wondering about the power consumption of my LLM-hosting workstations, then no, my self-hosted models barely contribute to my energy bills. …
… If you're using Ollama, you don't even need a custom one; you can add other cloud LLMs if you've got a subscription to them. …
… However, the most common complaint is that self-hosted models aren’t capable of anything more than serving as chatbots. …
