I finally found an open-source local LLM that actually competes with cloud AI
…My first run with Gemma 4 in LM studio It was a mixed bag LM Studio was the obvious starting point. It's what I already run all my other local models…
Search
Related topics:
Google Gemma
All sources
xda-developers.com
62
developer.nvidia.com
18
blogs.nvidia.com
15
android-developers.googleblog.com
6
wccftech.com
4
androidauthority.com
4
amd.com
4
arstechnica.com
3
androidpolice.com
3
tomshardware.com
2
9to5mac.com
2
phoronix.com
2
Tracked topic
Google Gemma
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
I ran a full LLM on my phone with no internet, and it's more useful than I expected
…You don't need beefy hardware to run Gemma 4 models Not like other local models The reason why local LLMs haven't really appealed to me is more so my fault…
Bringing AI Closer to the Edge and On-Device with Gemma 4 | NVIDIA Technical Blog
…On NVIDIA Jetson, developers can run Gemma 4 inference at the edge using llama.cpp and vLLM. Jetson Orin Nano supports the Gemma 4 e2b and e4b variants, enabling multimodal inference on…
Google Gemma 4 in your pocket: How to run the latest AI fully offline
…General technology AI Google Gemma 4 in your pocket: How to run the latest AI fully offline Google's new AI Edge Gallery brings local Gemma 4 AI to the Play Store…
Top stories
Run Google's Gemini LLMs right on your Mac with the new AI Edge Gallery
1w agoGoogle's new Gemma 4 12B model is designed to run on any laptop with 16GB of RAM
1w agoI use Claude Pro, Qwen 3-Coder, and Gemma 4 together, and it's the most cost-efficient AI workflow I've ever built
1w agoI put Google's Gemma 4 on my homelab and Tailscale on my phone — and cancelled Claude Pro
1w agoDay 0 Support for Gemma 4 on AMD Processors and GPUs
…Deploying on local hardware with LM Studio Gemma 4 models can be easily and performantly deployed on AMD hardware through the open-source llama.cpp project and LM Studio . Users can quickly…
I thought I needed a GPU for local LLMs until I tried this lean model
…Gemma 4 is impressive for anyone who values local AI. Google released it this week (April 2, 2026), and you can already try it with tools like LM Studio. It’s built…
Google's latest trick gets Gemma 4 running 3x faster right on your phone
…Google’s recently launched Gemma 4 edge AI models are especially designed to run locally on consumer-hosted hardware. While favorable from a privacy standpoint, local models can easily hog resources and…
Discussions and forums
Show HN: I made a Gemma 4 Mac app that names screenshots with local AI
I made my first macOS utility app that ships with a bundled Gemma 4 model, specifically the Gemma E4B one. It made my app DMG have 5.3 GB in size, but I think it is a small size for the power that this free local model c…
7
6
Qwen 3.6 27B vs Gemma 4 31B - making Packman game!
Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens. Gemma 4 31B: 27 tokens/sec · 3m 51s · 6,209 tokens. So what is more impo…
Show HN: Hitoku Draft – Context aware local assistant
Hi guys.I have been working on Hitoku Draft, an open-source, voice-first AI assistant that runs entirely locally. I posted about it already, and now it has also transcription with voice editing. Looking for feedback, as …
15
1
Update on 12x32gb sxm v100 cluster / local AI for legal drafting
Update from the lawyer with the V100 server. A few of you asked what I actually ended up running once the dust settled, so here it is. Still just a lawyer, still driving the whole thing through Claude Code, still not ful…
Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?
Claude Code like agentic workflow ai too costly for me.Any LLM can I run with VSCode at the below setup? 16ram Intel core i7 h processor 13gen 512gb NVMe SSD I want to run the ai as local agentic workflow with Vscode.I w…
5
2
Gemma 4 Is Now Available on Docker Hub | Docker
…Siri Varma Vegiraju Read now May 5, 2026 Generate Images Locally with Docker Model Runner and Open WebUI Learn how to generate images locally with Docker Model Runner and Open WebUI using…
Forget Gemini and Claude, this is the free game-changing AI tool you need to try on Google Pixel
…It’s running locally on your hardware. Related I tried Android's Desktop Mode, and I might never use my laptop again Android's Desktop Mode surprised me What is Gemma 4…
I ran Gemma 4 and Qwen 3.5 for the same local tasks, and one pulled miles ahead
…Sign in to your XDA account Local LLMs are one of those things that started off as a novelty and ended up being more useful than I expected . After running them for…