Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Advanced agents are increasingly demonstrating the potential to operate as autonomous engineers, creating a growing demand for evaluation benchmarks that capture the complexity of…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Computer-use agents (CUAs) increasingly operate in runtimes that combine visual desktop control, command-line execution, code editing, browsers, and external tools. Existing benchmarks…
…Abstract MCP-Persona benchmark evaluates agent performance on personalized tools interacting with individual accounts and local databases, revealing significant challenges in current SOTA agents. Generated by Qwen/Qwen2.5-Coder-32B-Instruct…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Evaluating embodied robot foundation models remains a critical bottleneck; unlike large language models efficiently assessed via digital benchmarks, robotic policies require slow, costly real…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Large language models (LLMs) are increasingly proposed as clinical agents , yet static, single-turn benchmarks cannot capture how a model dynamically delivers care across…
…We further demonstrate benchmark utility through RLVR-style fine-tuning of open-weight vision-language models . Our trained Qwen3-VL-8B model improves over Qwen-3-VL-8B-Thinking from 2.8…
…A bilingual multi-attribute benchmark for instruction-guided speech editing is introduced to systematically evaluate speech modification capabilities across atomic and compositional tasks. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Instruction…
…A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing (2026) KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs (2026) MINT-Bench: A Comprehensive Multilingual Benchmark for Instruction…
…Training and Benchmarking Scene Text Editing (2026) Qwen-Image-2.0 Technical Report (2026) FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching (2026) HiDream-O1-Image: A Natively Unified…
…3D modeling tasks through a benchmark and ranking platform that assess their ability to translate text and images into executable 3D code. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Procedural 3D…