Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…and self-distillation reshapes the benchmark profile. After SFT on self-distilled data, the 3B model reaches performance comparable to, and in aggregate slightly above, Qwen3-Omni-30B-A3B-Instruct without using…
…Dieses verfügt zwar über 2,8 Billionen Parameter, soll in mehreren Benchmarks jedoch hinter Qwen3.8-Max zurückliegen. Damit setzt sich auch der intensive Wettbewerb innerhalb der chinesischen KI-Branche fort, in…
…Tiantian Feng , , , , , , , , , , , , Abstract ChildVox presents a comprehensive benchmark for analyzing children's acoustic communication across developmental stages using diverse audio and speech models. Generated by Qwen/Qwen2.5-Coder-32B-Instruct We…
…Across three model families (Qwen3, Gemma-3, OLMo-3.1), mean-ablating the top LOCOS heads on the NoLiMa non-literal retrieval benchmark collapses ROUGE-L at lower head counts than prior…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…The website relies on Qwen 3.5 models for benchmarking: Qwen3.5-9B – Required (Small device baseline) Qwen3.5-27B – Required (Mid-range device baseline) Qwen3.5-35B-A3B (MoE) – Optional (MoE…
…the Qwen3-VL-4B-Instruct backbone action aware before any continuous control is learned, and flow matching posttraining then attaches a DiT action expert under knowledge insulation . On the LabUtopia benchmark , LabVLA…
…As per the preliminary benchmarks on WeChat, the V4-Pro model outcompetes Opus 4.8 on Terminal Bench 2.1, Cybergym, DeepSWE, and AutomationBench benchmarks Do note that DeepSeek's limited compute…
Papers arxiv:2606.03920 Benchmarking Visual State Tracking in Multimodal Video Understanding Published on Jun 2 Submitted by Pinzhi Huang on Jun 3 VISIONx @ NYU Authors: , , Pinzhi Huang , , Shusheng Yang , , Ellis Brown…
…With approximately 65\% as many pretraining tokens as Qwen3, LLaDA MoE v2 approaches Qwen3 on several knowledge, reasoning, and coding benchmarks. After supervised fine-tuning alone, it outperforms SDAR Chat on seven…
Papers arxiv:2606.18943 Physics-IQ Verified Published on Jun 17 Submitted by taesiri on Jun 18 Authors: , , , , , , Abstract A systematic evaluation of the Physics-IQ benchmark reveals limitations in measuring physical…