…Across a diverse set of benchmarks covering document understanding, OCR, and general VQA, LLaVA-UHD v4 reduces visual-encoding FLOPs by 55.8% while matching or even surpassing baseline performance. These results…
…On established Multimodal Tabular Learning benchmarks, we show that tuning the embeddings to the task improves performance. Existing benchmarks, however, often focus on the mere co-occurrence of modalities; this leads to…
…Benchmarking GPU Kernel Generation in Production Published on May 22 Submitted by Gabriele Oliaro on May 27 Snowflake Authors: , , , , , , , Abstract FastKernels addresses the gap between benchmark evaluation and production performance for LLM…
…Qiyao Wang , , , , , , Abstract PatRe benchmark models the complete patent examination process as a dynamic, multi-turn interaction between examiners and applicants, revealing key performance differences among LLMs in legal reasoning and technical…
…SeePhys Pro benchmark reveals that current multimodal models struggle with representation-invariant reasoning when information shifts from text to visual formats, and demonstrates that blind training can improve performance through residual textual…
…LightOnOCR-1B would fit nicely in this comparison as a strong performer that punches above its weight: 🎯 Performance : Achieves state-of-the-art results on OlmOCR Benchmark for its size—beats DeepSeek…
…A multi-scale study further examines how model performance changes as balanced training data increases from 1K, 10K to 100K images. Urban-ImageNet provides a unified, theory-grounded, multi-city benchmark for…
…Our CAFE provides a controlled benchmark for diagnosing whether promptable segmentation models perform concept-faithful grounding rather than shortcut-driven mask retrieval. View arXiv page View PDF Project page GitHub 4 Add…
…Experiments demonstrate that our dataset and the model trained on it achieve substantially better performance than all existing baselines on both OpenVE-Bench and Sparkle-Bench. Our proposed dataset, benchmark, and model…
Papers arxiv:2605.03941 A Benchmark for Interactive World Models with a Unified Action Generation Framework Published on May 5 Submitted by taesiri on May 6 Authors: , , , , , , , , , , Abstract A comprehensive benchmark named…