…However, most modern SSL methods rely on pseudolabels for unlabeled data, and typically assess their reliability through model confidence or uncertainty, measures that are self-referential and lack explicit grounding in segmentation…
…AI-generated summary We revisit a universally accepted but under-examined design choice in every modern LLM: a token index is looked up once at the input embedding layer and then permanently…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Mid-training has become an important stage in modern LLM development, using large-scale curated mixtures to strengthen capabilities before final post-training. Its…
…A subsumption test shows that phi_first is moderately to strongly correlated with semantic agreement , and combining the two signals yields only a small AUROC improvement over phi_first alone. These results…
…AI-generated summary Modern retrieval systems , whether lexical or semantic, expose a corpus through a fixed similarity interface that compresses access into a single top-k retrieval step before reasoning. This abstraction…
…sufficient early-stage training to build a solid foundation, followed by moderate late-stage training to mitigate overfitting and achieve better final performance. The code and data are publicly available at https…
…View arXiv page View PDF Add to collection Community In this paper, we tackle the problem of tracing where LLM-generated code may come from. We focus on cases where code models…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Curating training data is among the most consequential yet labor-intensive parts of modern AI development: practitioners iteratively propose, implement, evaluate, and revise data…
…View arXiv page View PDF Add to collection Community Recurrent LLM architectures have emerged as a promising approach for improving reasoning, as they enable multi-step computation in the embedding space without…
…View arXiv page View PDF GitHub 39 Add to collection Community We are excited to share our new paper: “Large Language Models Explore by Latent Distilling.” The core question we study is…
To show you the most relevant results, we’ve omitted some entries very similar to those already shown. Repeat the search with the omitted results included.