Tracked topic
Qwen3 is an AI model family developed by Alibaba, released as a set of large language models for natural-language tasks.
…Abstract Game development frameworks and benchmarks were created using data from game jam competitions to evaluate code generation and project-level programming capabilities. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Current…
…Now, a new benchmark test has just given us interesting insights into Apple's new CoreAI engine. Firstly, for small models such as the 0.6-billion-parameter Qwen3, CoreAI is around…
…7B and Qwen3-Omni-30B on OmniVideo-100K yields performance gains of up to 20.59% on OmniVideo-Test , demonstrating strong generalization (up to 12.64% improvements) across established benchmarks like Daily…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Many everyday programming tasks resist clean rule-based implementation, such as alerting on important log lines, repairing malformed JSON, or ranking search results by…
Alibaba previewed Qwen3.8-Max this week. The claim: a 2.4T-parameter multimodal model that's second only to Anthropic's Fable 5. The pricing is what makes it interesting. - Fable 5: $10 in / $50 out per M tokens - Qwen3.…
I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other l…
submitted by /u/anderspitman to r/LocalLLaMA [link] [comments]
https://preview.redd.it/uvdb7g4o7djh1.png?width=1600&format=png&auto=webp&s=1db6176144bcf8f40efb15cc04e8370ad52bfe2f https://preview.redd.it/rj4l66eq7djh1.png?width=1257&format=png&auto=webp&s=692b5f76c96e5910fff22ebf576…
Just came across this coding benchmark: SciCode Artificialanalysis.ai reports a ranking which contradicts the feeling we've towards those models in real life coding. Is Gemma 4 really that good, or a benchmarking issue? …
…Following up on the recent release of Qwen3 , the latest addition to the Qwen family of large language models (LLMs), we are thrilled to share our initial performance benchmarking results and use…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Search Agents -- large language models augmented with search tools -- have intensified the need for future-proof evaluation benchmarks. Existing benchmarks such as BrowseComp rely…
…Built on Qwen3-VL-30B-A3B , TaskMem improves VQA accuracy by 6.3%, 7.0%, and 5.3% on these benchmarks, respectively. View arXiv page View PDF Project page Add to collection…
…Sicheng Yang , , , , , , , Abstract ClinHallu is a benchmark for diagnosing and mitigating hallucinations in medical multimodal large language models through stage-wise reasoning analysis and trace-supervised fine-tuning. Generated by Qwen/Qwen2…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Memory has become a standard substrate for self-evolving agents , yet retaining experience is not the same as learning how to evolve through it…