Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Existing benchmarks for MLLM-generated web artifacts assess interaction through local evidence and miss the requirement-induced states and transitions that determine whether a…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct As recommender systems transition toward agentic, multi-turn conversational interfaces , evaluation paradigms have struggled to keep pace. Current benchmarks often rely on " LLM-as…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Enterprise property graphs vary widely in schema structure, internal terminology, domain assumptions, governance constraints, and user interaction patterns. A deployment-relevant Text2Cypher benchmark therefore…
…Claude Fable 5, Claude Sonnet 5, Claude Opus 4.8, GLM 5.2, Kimi K2.7 Code, MiniMax M3, Qwen 3.7 Plus, and Qwen 3.7 Max. Even the initial release…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…Bench (IA-Bench), a benchmark covering four core image agent capabilities : Plan , Reason , Search , and Memory . Experiments on IA-Bench, Mindbench and WISE-Verified show that Qwen-Image-Agent outperforms strong baselines…
…Qwen3.5 27B scores 68.5% and Qwen3.5 9B hits 66.1% and then there's a big drop: Qwen 3.5 4B drops to 50.3%, and Qwen 3.5…
…and layouts pose a significant misinformation threat requiring new detection benchmarks and methods beyond surface-level credibility assessment. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Recent generative models can now produce…
…Additional zero-shot analyses on RoboTwin-IF benchmark further support robust generalization and multi-view consistency. View arXiv page View PDF Project page Add to collection Community Qwen3.7-Max is already…
…We instantiate BraveGuard by training multiple guard backbones , including Qwen3-Guard and Llama-Guard variants, and evaluate the resulting guards on trajectory-level agent-safety benchmarks. BraveGuard consistently improves safety detection across…
…With Qwen3-4B as the backbone, our framework achieves the strongest aggregate performance on our benchmarks, outperforming larger proprietary LLMs (e.g., GPT, Gemini) and fixed-environment training baselines. We further analyze…