Running local AI on the Raspberry Pi 5 taught me why cloud models are still winning
…Llama, Gemma, and Deepseek. I opted to install the smallest version of each model, as I only had 32GB of space on the SD Card. Using LLMs on the SBC was responsive…
Search
Related topics:
DeepSeek
Tracked topic
DeepSeek
Live now
web_search tool in deepseek harness needs api key from deepseek and deepseek charges you as deepseek-v4-flash usage.
Live sources:
r/LocalLLaMA
I started self-hosting LLMs and absolutely loved it
…It supports most open models like DeepSeek, LLaMA, and others, and you can even load your own if you want. It also handles optimizations automatically to ensure the models run efficiently based…
I built Andrej Karpathy's "LLM Council" on my own hardware, and now no single model gets the last word
…Three local LLMs — DeepSeek-R1 8B, Qwen 3.5 9B, and Gemma 4 E4B — were running via Ollama. And for a familiar interface, I used Open WebUI. I used similar sets of…
Ollama is still the easiest way to start local LLMs, but it's the worst way to keep running them
…When DeepSeek released its R1 model family in early 2025, Ollama listed the smaller distilled versions, models like DeepSeek-R1-Distill-Qwen-32B, simply as "DeepSeek-R1" in their library. This created…
6 local LLMs I've used that prove they're not just smaller versions of cloud models
…DeepSeek V4 Flash runs a 284B model on more accessible hardware than you'd think It actually works decently well DeepSeek V4 Flash is a 284B mixture-of-experts with only about…
I stopped treating AI models like Pokémon—I don't need to collect them all
…I downloaded Llama, Mistral, DeepSeek, Qwen, Gemma, GPT-OSS, and several variants of these models. Every new release sounded promising, and since Ollama and LM Studio made pulling a model so easy…
Local LLMs work best when you're not loyal to just one
…For example, Qwen 2.5 Coder (the higher parameter variants) and GPT-OSS are considered the creme de la creme for programming workloads, while the DeepSeek lineup is typically the preferred option…
I stopped forcing every coding job through Claude and started using this instead
…For routine coding tasks, I can use a cheaper model such as DeepSeek and keep costs low. When I need more reasoning power, I can switch to a more capable model like…
High-VRAM GPUs aren't the future of local AI — unified memory and Mixture of Experts models are
…For example, when we tested the Mac Studio, we were able to run DeepSeek R1's full 671B at Q4 on it , generating at a speed of approximately 15 to 20 tokens…
This AI note-taking app does something Notion and OneNote can't, and it's the reason I ditched my subscriptions
…In BuildinAI, the dropdown gives you GPT, Gemini, and DeepSeek, with DeepSeek V3 added recently. Notion doesn't tell you what powers Notion AI, and there's no swap option, so if…