Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Frontier model evaluations are shifting from foundational capabilities (e.g., instruction following and reasoning) toward compositional, agentic ones, but Korean agentic benchmarks remain scarce…
…Yuichi Tateno Abstract HAKARI-Bench provides a lightweight benchmark for comparing retrieval methods across multiple configurations and languages, enabling efficient model selection and performance analysis. Generated by Qwen/Qwen2.5-Coder-32B…
…Evaluations on mathematical reasoning benchmarks using Qwen3 models reveal an emergent phenomenon : geometric latent reasoning induces substantially shorter generations without an explicit length objective. By replacing early explicit reasoning with continuous latent…
…Qwen3-4B solver, we log post-generation intervention outcomes and train recoverability-aware gates from serving-visible signals such as completion status, token use, finalizer use, and attempt state. Across benchmarks, SEVRA…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…State-of-the-art among open-source models — across ten benchmarks; notably, a 7B agent beats the 10× larger Qwen2.5-VL-72B on LVBench (50.5 vs. 47.3) using ~73…
…The comprehensive evaluations of Qwen3.6-35B-A3B against peer-scale models across a wide range of tasks and modalities. Figure 1: Performance on Coding Agent & Reasoning Benchmarks Run Qwen3.6 with…
…benchmark reveals limited performance of current LLM agents in physical science research, leading to development of DelveAgent framework that improves accuracy through modular design and physics-grounded mechanisms. Generated by Qwen/Qwen2…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Recent multimodal large language models have shown great promise in clinical image reasoning, but existing post-training pipelines remain predominantly outcome-centric, relying on…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Evaluating LLM agents on benchmarks like SWE-Bench and GAIA can be expensive, time-consuming, and requires complex infrastructure. A single evaluation can cost…
…Key Takeaways Day-0 support across the AMD Instinct GPUs Optimized ROCm enablement SGLang /vLLM/ATOM readiness Performance highlights and benchmark placeholders Quickstart deployment instructions What’s New in Qwen 3.8…