Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…it's actually pretty good at running local agents, especially when it's paired with 128GB of RAM. AMD itself used quantization with Qwen 3.5 to achieve 29.84 tok/s…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Multimodal image fusion aims to integrate complementary information from different modalities into a fused image that preserves rich local details while maintaining globally consistent…
…Experimental results show our method achieves up to 1.8x end-to-end acceleration in async RL training of Qwen3.5, Qwen3.6, and Qwen3.7 models. View arXiv page View PDF…
…The way it handles tool integration, file edits, and permissions just feels more polished to me, and I've had better success with local models like Qwen3 Coder Next with Claude Code…
…Qwen 3.5 4B My go-to local coding model I mainly use Qwen 3.5 4B for coding. I’m running Qwen3.5-4B-UD-Q8_K_XL, an 8-bit…
…Local Qwen 2.5 1.5B comparison between TGP and StreamingLLM. 6.2 ARUY’s TGP vs vLLM In a second local test, TGP was compared against vLLM using Qwen 2.5…
…I can hit Ctrl+L to switch models mid-session, like from Qwen 3.6 27B to Qwen 3.6 35B A3B, and the context carries over. Finally, it also supports AGENTS…
Hey locallama! We recently open sourced a Qwen3-TTS 1.7B implementation that achieves 10 requests per second (RPS) and sub-50 ms p95 time-to-first-audio (TTFA) while maintaining real-time playback on 1 x H100. This exten…
QwQ was genuine next-gen performance usable on local hardware, but the massive required context (it's reasoning style was akin to "if I say every possible word, I'll notice the right one!") kinda made it unusable for age…
Looking for V100 users to share your config and it's performance. GPU: Tesla V100 PCIE 32Gb Qwen3.6 27B Q4_K_M + Q8_0 MTP 128K context length Pi coding agent llama.cpp model preset: [*] spec-default = 1 ctx-size = 131072…
Qwen3.8-Max (2.4T) is another massive contribution to the open weight community. On benchmarks, it performs closely to Kimi K3 and DeepSeek V4 flash across all categories and is better at coding and software tasks. Qwen3…
Good afternoon, everyone! I wanted to show the work I've been doing around porting Ninfer over to the CMP170HX (Github) So, first, I do want to call out the amazing work that Neroued, Sergiuszm and specifically Don-Chad …
…container with Claude Code pointed straight at the local endpoint, where it generates at a rate between 25 and 40 tokens a second. Qwen 3.6 has a 27B dense variant and…
…Access the latest models optimized for on-device performance with the NVIDIA In-Game Inferencing (NVIGI) SDK 1.6 update. Qwen 3.5 4B: This cutting-edge small language model (SLM) delivers…
…That limitation made my local-first setup frustrating for more complex tasks because the model would often get stuck. I am using Qwen 2.5 , and while it is impressive for its…