I replaced GitHub Copilot with a self-hosted AI and I won’t go back
…run local LLMs to handle the tasks I was using Copilot for, and it's never been easier. There's also never been more choice for local use, whether that's Gemma…
Search
Related topics:
Google Gemma
All sources
xda-developers.com
69
developer.nvidia.com
15
blogs.nvidia.com
13
android-developers.googleblog.com
5
androidauthority.com
4
wccftech.com
3
arstechnica.com
3
phoronix.com
3
tomshardware.com
2
extremetech.com
2
9to5mac.com
2
amd.com
2
Tracked topic
Google Gemma
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
Running local LLMs every day for five months broke every assumption I had about them
…Sign in to your XDA account I got into local LLMs because it seemed interesting, if I’m being completely honest. Running my own AI on my own hardware just felt like…
You don't need an expensive GPU to run a local LLM that actually works
…While Falcon, Gemma (Google), and Mistral are all legitimate open-weight models you can run locally, Meta's Llama series is arguably the most widely adopted and has the largest ecosystem of…
Arch Linux AUR Hit By Another Wave Of Now More Sophisticated Malware Attack
…Boichat discovered those latest malware bits using a local Gemma E2B AI model. The new malware attempt in AUR was described as "a bit more elaborate" in obfuscating the action around the…
Top stories
This tiny AI companion does what Clippy promised 30 years ago
…version seems to be built on Gemma 3. There's not much difference between the models for what OMNI can handle, and they run locally on your device, so you get privacy…
Self-hosted LLM took my personal knowledge management system to the next level
…Configure local API endpoint Inside the plugin settings, I entered the local Ollama host URL. Since Ollama runs locally, the plugin can directly communicate with the model through the API. This helps…
Run DiffusionGemma on NVIDIA for Developer-Ready, High-Throughput Text Generation | NVIDIA Technical Blog
…nvcr.io/nim/google/diffusiongemma-26b-a4b-it:latest” $ docker run --gpus=all \ -e NGC_API_KEY=$NGC_API_KEY \ -v "$LOCAL_NIM_CACHE:/opt/nim/.cache" \ -p 8000:8000 \ ${NIM_IMAGE…
Discussions and forums
Show HN: I made a Gemma 4 Mac app that names screenshots with local AI
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model c…
7
6
Qwen 3.6 27B vs Gemma 4 31B - making Packman game!
Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens. Gemma 4 31B: 27 tokens/sec · 3m 51s · 6,209 tokens. So what is more impo…
Show HN: Hitoku Draft – Context aware local assistant
Hi guys.I have been working on Hitoku Draft, an open-source, voice-first AI assistant that runs entirely locally. I posted about it already, and now it has also transcription with voice editing. Looking for feedback, as …
15
1
Update on 12x32gb sxm v100 cluster / local AI for legal drafting
Update from the lawyer with the V100 server. A few of you asked what I actually ended up running once the dust settled, so here it is. Still just a lawyer, still driving the whole thing through Claude Code, still not ful…
Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?
Claude Code like agentic workflow ai too costly for me.Any LLM can I run with VSCode at the below setup? 16ram Intel core i7 h processor 13gen 512gb NVMe SSD I want to run the ai as local agentic workflow with Vscode.I w…
5
2
LM Studio's frontend was slowing me down, so I switched to this instead
…up vLLM as the backend, with Gemma 4's mix-of-experts model to begin with, and Open WebUI as the front end. It's running on Ubuntu via WLS2 , partly because…
Open Notebook’s AI-powered podcasts are a game-changer for productivity, provided you’re willing to configure them right
…Performance-wise, this setup is able to generate a 15ish minute podcast with three speakers in roughly 20 minutes, which is pretty impressive considering that everything runs on a local AI pipeline…
I ditched Claude Projects for a self-hosted setup that costs nothing and does more
…gap was smaller than I expected Where the local LLM fits in LM Studio runs the server, Fabric sends the prompts The local LLM part of the setup actually happens inside that…