Tracked topic
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
…I can put my old graphics cards to good use Like most LLM-hosting enthusiasts, I started my journey by hosting local models on Ollama , and it served me well for the…
…Turns out, the cluster’s performance was worse than a standalone SBC I blame slow network provisions for this bottleneck Since I was using the fairly lightweight Gemma 3 4B, I expected…
…Llama, Gemma, and Deepseek. I opted to install the smallest version of each model, as I only had 32GB of space on the SD Card. Using LLMs on the SBC was responsive…
…It ain’t perfect, but it’s a decent secondary LLM server I’ve got a Gemma4-26B-A4B instance that runs on my GTX 1080 24/7, and I use it…
…Qwen See at Github Replacing the AI is only the first step I found a replacement for everything I use Adding a local LLM is only part of the equation, because Google…
…used it for is text, so chatting, brainstorming, parsing documents, and analyzing images when I'm running something with vision like Gemma 4 . Real design work was a different story though... Local…
…I already use one workstation for my Proxmox experiments, while the other is my main gaming/video-editing/coding machine. Then there’s the privacy advantage of hooking local LLMs up to…
…Gemma 4 isn't the smartest local LLM I've run, but it's the one I reach for most Google's newest Gemma 4 models are both powerful and useful. The…
…The runtime picker asks you to choose between AMR, a local coding agent CLI like Claude Code or Codex or Cursor, or BYOK. I don't use any of those CLIs and…
…Related 7 self-hosted services I use that can run perfectly on a Raspberry Pi Not every self-hosted application requires a top-of-the-line workstation Open WebUI + local LLMs provide…