Chejian Xu and co-authors write about Evo2, a framework for weight-harness co-evolution in self-evolving agents. Existing methods typically improve either model weights or the agent harness separately, overlooking the relationship between the two. Evo2 proposes a dual-role pipeline where a single policy serves as both a Proposer (writing harness edits) and a Reflector (diagnosing their effects). The training pipeline EvoTIDE recovers usable trajectories through edit extraction and prefix continuation, combining supervised fine-tuning with interleaved GRPO.
- Achieves 82.1% on Polyglot and 48.3% on SWE-bench Verified, outperforming the strongest baselines (62.6% and 41.0% respectively)
- Evolved harnesses transfer to different tasks without further evolution and rank first in cross-benchmark evaluations
- The framework extends to proprietary models, improving a GPT-5-mini agent's performance from 24.4% to 48.3%
- Achieves 82.1% on Polyglot and 48.3% on SWE-bench Verified, outperforming the strongest baselines (62.6% and 41.0% respectively)
- Evolved harnesses transfer to different tasks without further evolution and rank first in cross-benchmark evaluations
- The framework extends to proprietary models, improving a GPT-5-mini agent's performance from 24.4% to 48.3%
Dimension Reducers builds tools to formalize, stress-test, verify, and structure mathematical knowledge. They offer solutions for LLM training, automated refereeing, and retrieval that understands mathematical structure. Their platform includes tools for refereeing at scale, adversarial testing ("torture testing"), and structured Retrieval Augmented Generation (RAG).
Key products include DiRe-JAX (a dimensionality reduction library), arXiv Math Semantic Search, arXiv Proof Audit Database, Mathematics Torture Chamber, and a Lean 4 Formalization Pipeline. They also publish research and benchmarks in mathematical formalization and OCR, emphasizing semantic accuracy and robustness.
Key products include DiRe-JAX (a dimensionality reduction library), arXiv Math Semantic Search, arXiv Proof Audit Database, Mathematics Torture Chamber, and a Lean 4 Formalization Pipeline. They also publish research and benchmarks in mathematical formalization and OCR, emphasizing semantic accuracy and robustness.
We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters. For each model size, we release three variants: a pretrained base model for general-purpose use, an instruction finetuned, and a reasoning model for complex problem-solving.
A recap of the author's Boggle project, including media coverage, a published paper on arXiv.org, new optimizations, and reflections on the challenges and future directions.
This survey paper outlines the key developments in the field of Large Language Models (LLMs), such as enhancing their reasoning skills, adaptability to various tasks, increased computational efficiency, and ability to make ethical decisions. The techniques that have been most effective in bridging the gap between human and machine communications include the Chain-of-Thought prompting, Instruction Tuning, and Reinforcement Learning from Human Feedback. The improvements in multimodal learning and few-shot or zero-shot techniques have further empowered LLMs to handle complex jobs with minor input. They also manage to do more with less by applying scaling and optimization tricks for computing power conservation. This survey also offers a broader perspective on recent advancements in LLMs going beyond isolated aspects such as model architecture or ethical concerns. It categorizes emerging methods that enhance LLM reasoning, efficiency, and ethical alignment. It also identifies underexplored areas such as interpretability, cross-modal integration and sustainability. With recent progress, challenges like huge computational costs, biases, and ethical risks remain constant. Addressing these requires bias mitigation, transparent decision-making, and clear ethical guidelines. Future research will focus on enhancing models ability to handle multiple input, thereby making them more intelligent, safe, and reliable.
This repository provides a Python script to fetch and summarize research papers from arXiv using the free Gemini API. It includes features for summarizing a single paper or multiple papers, easy setup, and automatic daily extraction and summarization based on specific keywords. The tool is designed to help researchers, students, and enthusiasts quickly extract key insights from arXiv papers without manually reading through lengthy documents.
The arXiv Paper Visualizer allows users to visually explore the development of ideas in academic papers. It helps users sift through daily arXiv publications by selecting the best papers according to their preferences.
The article introduces a new approach to language modeling called test-time scaling, which enhances performance by utilizing additional compute resources during testing. The authors present a method involving a curated dataset and a technique called budget forcing to control compute usage, allowing models to double-check answers and improve reasoning. The approach is demonstrated with the Qwen2.5-32B-Instruct language model, showing significant improvements on competition math questions.
Jupyter notebook for using LlamaIndex with arXiv papers for retrieval-augmented generation (RAG).
An article explaining why and how beginners in machine learning should read academic papers, highlighting the vast amount of information available on arXiv and the benefits of engaging with these papers for learning and staying updated.
