Chejian Xu and co-authors write about Evo2, a framework for weight-harness co-evolution in self-evolving agents. Existing methods typically improve either model weights or the agent harness separately, overlooking the relationship between the two. Evo2 proposes a dual-role pipeline where a single policy serves as both a Proposer (writing harness edits) and a Reflector (diagnosing their effects). The training pipeline EvoTIDE recovers usable trajectories through edit extraction and prefix continuation, combining supervised fine-tuning with interleaved GRPO.
- Achieves 82.1% on Polyglot and 48.3% on SWE-bench Verified, outperforming the strongest baselines (62.6% and 41.0% respectively)
- Evolved harnesses transfer to different tasks without further evolution and rank first in cross-benchmark evaluations
- The framework extends to proprietary models, improving a GPT-5-mini agent's performance from 24.4% to 48.3%
- Achieves 82.1% on Polyglot and 48.3% on SWE-bench Verified, outperforming the strongest baselines (62.6% and 41.0% respectively)
- Evolved harnesses transfer to different tasks without further evolution and rank first in cross-benchmark evaluations
- The framework extends to proprietary models, improving a GPT-5-mini agent's performance from 24.4% to 48.3%
The paper titled "Attention Is All You Need" introduces the Transformer, a novel architecture for sequence transduction models that relies entirely on self-attention mechanisms, dispensing with traditional recurrence and convolutions. Key aspects of the model include:
- Architecture: The Transformer consists of an encoder-decoder structure, with both components utilizing stacked layers of multi-head self-attention mechanisms and feed-forward networks. It avoids recurrence and convolutions, allowing for greater parallelism and faster training.
- Attention Mechanism: The model uses scaled dot-product attention for computing attention scores, which scales down the dot products to prevent softmax from saturating.
- Multi-head attention is employed to allow the model to attend to information from different representation subspaces at different positions.
- Training and Regularization: The authors use the Adam optimizer with a particular learning rate schedule that initially increases the rate and then decreases it based on the number of training steps. They also employ techniques like dropout and label smoothing to regularize the model during training.
- Performance: The Transformer achieves state-of-the-art results on machine translation benchmarks (WMT 2014 English-to-German and English-to-French), outperforming previous models with significantly less training time and computational resources.
- Generalization: The model demonstrates strong performance on tasks other than machine translation, such as English constituency parsing, indicating its versatility and ability to learn complex dependencies and structures.
The paper emphasizes the efficiency and scalability of the Transformer, highlighting its potential for various sequence transduction tasks, and provides a foundation for subsequent advancements in natural language processing and beyond.
- Architecture: The Transformer consists of an encoder-decoder structure, with both components utilizing stacked layers of multi-head self-attention mechanisms and feed-forward networks. It avoids recurrence and convolutions, allowing for greater parallelism and faster training.
- Attention Mechanism: The model uses scaled dot-product attention for computing attention scores, which scales down the dot products to prevent softmax from saturating.
- Multi-head attention is employed to allow the model to attend to information from different representation subspaces at different positions.
- Training and Regularization: The authors use the Adam optimizer with a particular learning rate schedule that initially increases the rate and then decreases it based on the number of training steps. They also employ techniques like dropout and label smoothing to regularize the model during training.
- Performance: The Transformer achieves state-of-the-art results on machine translation benchmarks (WMT 2014 English-to-German and English-to-French), outperforming previous models with significantly less training time and computational resources.
- Generalization: The model demonstrates strong performance on tasks other than machine translation, such as English constituency parsing, indicating its versatility and ability to learn complex dependencies and structures.
The paper emphasizes the efficiency and scalability of the Transformer, highlighting its potential for various sequence transduction tasks, and provides a foundation for subsequent advancements in natural language processing and beyond.
This paper explores the emergence of self-replicating programs in various computational substrates. The study demonstrates that self-replication can arise from random interactions and self-modification in these environments, highlighting the emergence of complex dynamics.
