Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…3D modeling tasks through a benchmark and ranking platform that assess their ability to translate text and images into executable 3D code. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Procedural 3D…
…benchmark and execution framework for evaluating phone-use agents on verifiable mobile workflows, demonstrating superior performance over existing approaches through deterministic action routing and auditable execution traces. Generated by Qwen/Qwen2.5…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Agent benchmarks are growing fast, but no single benchmark touches more than four or five of the dimensions that deployment exposes. This paper aggregates…
…Specifically, EEVEE improves average multi-benchmark scores by 10.38 and 24.32 points over Qwen3-4B-Instruct and DeepSeek-V3.2, surpassing SOTA methods GEPA and ACE by up to 37…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Existing computer-use benchmarks fail to capture the realism, complexity, and long-horizon demands of real-world computer use, limiting their ability to reveal…
…Across all eleven benchmarks, AdaCodec improves over the Qwen3-VL-8B per-frame RGB baseline at a matched visual-token budget. Even at 1/7 the budget, AdaCodec with 32k tokens surpasses…
…Zhaoyan Sun , Shan Zhong , , , , , , , , , , , Abstract A comprehensive benchmark named AgenticDataBench is introduced to evaluate data agents across diverse domains with fine-grained task annotations and skill-based coverage metrics. Generated by Qwen…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Existing instruction-based video editing datasets commonly focus on single-task appearance editing, failing to meet the complex creative demands of real-world scenarios…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Most coding-agent benchmarks are static: an agent receives a complete task description up front and is judged only by its final code. Real…
…Qwen3-VL 8B was the newest model I tried and it ran the fastest - only surpassed by Qwen3 3B. Benchmarking with OpenVINO https://www.linkedin.com/pulse/benchmarking-openvino-steven-leve-gcg7c…