Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…distillation and weight interpolation, outperforming existing methods on a new benchmark while addressing structural biases in existing datasets. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Adapting a foundation vision-language encoder…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review . However, existing benchmarks rarely…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Large language models (LLMs) increasingly act as integrated data-science agents, combining abstract reasoning with advanced tool use . Yet the relevant benchmark landscape largely…
…On Qwen2.5-VL-3B with 136 Vision-FLAN tasks, MERIT improves the 8-benchmark average from 54.3 (joint training) to 57.0. The same recipe scales to a 7B model…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Real-world data analysis is inherently iterative, yet existing benchmarks mostly evaluate isolated or short interactive tasks, leaving agents' ability to track evolving analytical…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Current benchmarks for computer-use agents evaluate models in impersonal environments. This leaves a gap between evaluation and deployment where personal assistants are expected…
…16-inch MacBook Pro, with Alex Ziskind comparing all sorts of benchmarks, including AI workloads. Starting things off with Qwen3 4B running at 4-bit quantization and a Context Length of 262…
…presents a scalable benchmark for precise visual editing tasks, revealing low performance across models and identifying key challenges in geometric transformations and structural manipulations. Generated by Qwen/Qwen2.5-Coder-32B-Instruct…
…But Qwen 3.7 Max already reaches 92.4%, while GLM-5.2 and DeepSeek V4 Pro score 91.2% and 90.1%. The benchmark scores still favor the West. What they…
…Abstract X-Stream introduces the first benchmark for multi-stream streaming understanding, revealing significant limitations of current MLLMs in handling concurrent streams. Generated by Qwen/Qwen2.5-Coder-32B-Instruct While video…