I finally found an open-source local LLM that actually competes with cloud AI
…use every day (and it's not for coding) Local AI that actually fits into my day Google built one of the most accessible open models What makes Gemma 4 unique Gemma…
Search
Related topics:
Google Gemma
All sources
xda-developers.com
61
developer.nvidia.com
17
blogs.nvidia.com
14
android-developers.googleblog.com
6
wccftech.com
5
9to5mac.com
4
amd.com
4
androidauthority.com
4
arstechnica.com
3
androidpolice.com
3
huggingface.co
3
tomshardware.com
2
Tracked topic
Google Gemma
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
Day 0 Support for Gemma 4 on AMD Processors and GPUs
…Support is available in the Gemma 4 launch build of vLLM via docker image using the vLLM Gemma 4 recipe . docker pull vllm/vllm-openai-rocm:gemma4 For all AMD GPUs, vLLM…
Gemma 4 Is Now Available on Docker Hub | Docker
…Siri Varma Vegiraju Read now May 5, 2026 Generate Images Locally with Docker Model Runner and Open WebUI Learn how to generate images locally with Docker Model Runner and Open WebUI using…
Google's Gemma 4 finally made me care about running local LLMs
…Either way, it ends up feeling just like using ChatGPT, Gemini, or Claude, except everything runs locally and nothing ever leaves your machine. Similarly, you have a few options to run Gemma…
Top stories
Google's new Gemma 4 12B model is designed to run on any laptop with 16GB of RAM
1w agoI ran Gemma 4 and Qwen 3.5 for the same local tasks, and one pulled miles ahead
1w agoI use Claude Pro, Qwen 3-Coder, and Gemma 4 together, and it's the most cost-efficient AI workflow I've ever built
1w agoI put Google's Gemma 4 on my homelab and Tailscale on my phone — and cancelled Claude Pro
1w agoGoogle's free Gemma 4 model runs on hardware you probably already own
…Gemma 4 isn't the smartest local LLM I've run, but it's the one I reach for most Google's newest Gemma 4 models are both powerful and useful. Gemma…
Bringing AI Closer to the Edge and On-Device with Gemma 4 | NVIDIA Technical Blog
…Four models are included, featuring Gemmas first MoE model, and support for over 140 languages; these models enable reasoning, code generation, agent tool use, and multimodal input, and can be deployed locally…
Forget Gemini and Claude, this is the free game-changing AI tool you need to try on Google Pixel
…It’s running locally on your hardware. Related I tried Android's Desktop Mode, and I might never use my laptop again Android's Desktop Mode surprised me What is Gemma 4…
Discussions and forums
Using a Gemma4 Safetensor Already Downloaded Locally
Hi everyone. I need some help or advice. I’m learning how to use N8N, so I downloaded Docker and installed N8N locally. I also wanted to install Gemma4, which I use in ComfyUI to help with image generation prompts. Is it…
Qwen 3.6 27B vs Gemma 4 31B - making Packman game!
Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens. Gemma 4 31B: 27 tokens/sec · 3m 51s · 6,209 tokens. So what is more impo…
Show HN: Hitoku Draft – Context aware local assistant
Hi guys.I have been working on Hitoku Draft, an open-source, voice-first AI assistant that runs entirely locally. I posted about it already, and now it has also transcription with voice editing. Looking for feedback, as …
15
1
Ask HN: Any Local LLM can I run without GPU for Local Agentic workflow AI?
Claude Code like agentic workflow ai too costly for me.Any LLM can I run with VSCode at the below setup? 16ram Intel core i7 h processor 13gen 512gb NVMe SSD I want to run the ai as local agentic workflow with Vscode.I w…
5
2
Multi-Token Prediction (MTP) for LLaMA.cpp - Gemma 4 speedup by 40%
Implemented Multi-Token Prediction for LLaMA.cpp. Quantized Gemma 4 assistant models into GGUF format. Ran tests on a MacBook Pro M5Max. Gemma 26B with MTP drafts tokens 40% faster. Prompt: Write a Python program to find…
I ran a full LLM on my phone with no internet, and it's more useful than I expected
…It was far more useful than I had any right to expect. You don't need beefy hardware to run Gemma 4 models Not like other local models The reason why local…
I thought I needed a GPU for local LLMs until I tried this lean model
…And then I came across Google’s recently released Gemma 4 models and decided to give it a shot via the LM Studio . Related 5 self-hosted LLMs I use for specific…
I replaced the expensive Gemini AI Pro subscription with these local models, and my productivity didn't drop a bit
…using LM Studio and offloading the layers to my GPU, I have turned my local machine into a coding powerhouse that rivals anything the cloud can offer. Ministral 3 3B If Gemma…