Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…Hermes Agent, Claude Code, Qwen Paw and Qoder, it serves as a reliable backbone for different agent systems. The model achieves top-tier results across major benchmarks in coding, general-purpose agents…
…Llama 8B has the edge on code-heavy benchmarks, though Qwen 7B pulls ahead once math and general reasoning come into it, so grabbing whichever one happens to say "DeepSeek" doesn't…
…video reasoning dataset and benchmark designed to enhance knowledge-intensive video understanding through expert-domain content and human-in-the-loop example generation. Generated by Qwen/Qwen2.5-Coder-32B-Instruct We…
…Tested across dense and MoE families (Qwen3.5, Gemma-4, gpt-oss), securing massive surges on frontier benchmarks—including up to a +22.4% jump on categorized Omni-MATH Level 4, +9…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…On benchmarks, Qwen's own results have the 27B dense model edging ahead of the previous Qwen3.5-397B-A17B MoE on SWE-bench Verified, at 77.2% versus 76.2%. That…
…Then I moved to DeepSeek-R1 8B, Qwen 3.5 9B, and Gemma 4 E4B. I ran all three models with the same prompts and evaluated usefulness rather than benchmark numbers. I…
…a comprehensive benchmark for evaluating general-purpose terminal-use agents across diverse digital activities and specialized workflows, revealing significant performance gaps among current frontier agents. Generated by Qwen/Qwen2.5-Coder-32B…
…Jiacheng Zhang , , , , , , , Abstract SafePyramid benchmark evaluates guardrail systems' ability to identify safety violations through in-context policy specification across multiple domains and complexity levels. Generated by Qwen/Qwen2.5-Coder-32B-Instruct…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Understanding chart and table images is essential for applying vision-language models (VLMs) to real-world document understanding. While English benchmark s have advanced…
…A new benchmark evaluates multimodal large language models' ability to reason over dynamic visual evidence through controlled temporal-logical operations rather than simple object recognition. Generated by Qwen/Qwen2.5-Coder-32B…