SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness

Note: body below is original English text extracted from arXiv abs / HTML. Do not treat this file as a translation.

arXiv:2609.20519 · published 2026-09-17 · submitted 17 Sep 2026

Abstract

As coding agents move from supervised code completion to unattended, around-the-clock exploration, their work expands from isolated predictions into long trajectories of reasoning, tool use, and feedback. Token efficiency therefore becomes important for scaling recursive self-improvement. We take an RSI-inspired approach at the harness layer, scaling auto-research loops across increasingly numerous and diverse environments for harness rollouts. At this scale, the process yields reusable improvements that transfer beyond their development setting, moving automated harness discovery toward production-level outcomes. Four mechanisms survive selection and form SoL-Pi, spanning action execution, context compaction, observation handling, and delegated reading. On the 51-task EdgeBench evaluation, SoL-Pi achieves performance comparable to Pi across GPT-5.6 Sol and Opus 5 while reducing recorded token traffic by 44.7-49.0% and API cost by about one third. In other words, estimated hourly savings are $8.75-$13.50 relative to native Codex and Claude Code harnesses, and $4.36-$5.71 relative to Pi.

Authors

Haozhe Liu, Tian Ye, Sensen Gao, Qihang Cao, Yitong Li, Mingchen Zhuge, Duomin Wang, Ruihua Zhang, Ping Luo, Jiawang Bian, Lei Zhu, Ligeng Zhu

Key claims (verbatim-leaning English extract)

• As coding agents move from supervised code completion to unattended, around-the-clock exploration, their work expands from isolated predictions into long trajectories of reasoning, tool use, and feedback. Token efficiency therefore becomes important for scaling recursive self-improvement. We take an RSI-inspired approach at the harness layer, scaling auto-research loops across increasingly numerous and diverse environments for harness rollouts. At this scale, the process yields reusable improvements that transfer beyond their development setting, moving automated harness discovery toward production-level outcomes. Four mechanisms survive selection and form SoL-Pi, spanning action execution, context compaction, observation handling, and delegated reading. On the 51-task EdgeBench evaluation, SoL-Pi achieves performance comparable to Pi across GPT-5.6 Sol and Opus 5 while reducing recorded token traffic by 44.7-49.0% and API cost by about one third. In other words, estimated hourly savings are $8.75-$13.50 relative to native Codex and Claude Code harnesses, and $4.36-$5.71 relative to Pi.

• RSI-inspired harness auto-research: research AI inspects traces, proposes candidates, filters via capability and efficiency gates across diverse environments.

• Four retained mechanisms form SoL-Pi: Action Fusion, Online Context Compact, ObservationPack, and Evidence-Preserving Reducer (delegated reading).

• On 51-task EdgeBench, SoL-Pi achieves performance comparable to Pi across GPT-5.6 Sol and Opus 5 while reducing recorded token cost.

• Aims to move automated harness discovery toward production-level outcomes with transfer beyond development settings.

• SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness # SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness

• Haozhe Liu, Tian Ye, Sensen Gao, Qihang Cao, Yitong Li, Mingchen Zhuge Duomin Wang, Ruihua Zhang, Ping Luo, Jiawang Bian, Lei Zhu, Ligeng Zhu, Enze Xie, Song Han NVIDIA NTU MIT * Equal contribution. Core contributors. Code

• Figure 1: SoL-Pi discovers a more token-efficient harness through automated research. (a) SoL-Pi: Scaling Auto-Research Loop. Prepared research environments supply tasks to an AI running the base harness. A research AI inspects its execution traces, proposes candidate changes, and filters the idea pool through capability and efficiency gates. Four retained mechanisms are integrated and refined into SoL-Pi before the harness is frozen for evaluation on unseen benchmarks. The trace, ideas, and gate symbols are schematic: capability is checked within fixed tolerances, and held-out results never feed back into search. (b) Example results on EdgeBench: average score and API cost for the native ha

• Advances in foundation models enable agents to tackle increasingly open-ended tasks over longer horizons with less supervision [1, 2, 3, 4]. This shift supports applications such as autonomous research, software engineering agents, self-evolving personal assistants, and early forms of recursive self-improvement (RSI) [5, 6, 7, 8]. As agents operate over longer horizons, task-level token efficiency becomes a first-order systems concern [9, 10]. Existing efficiency work has primarily focused on lowering the cost per token through faster attention kernels and serving infrastructure [11, 12], model compression techniques such as quantization [13, 14], or the use of cheaper models [15, 16]. In th

• Harness-level optimization can improve efficiency without additional model training, complementing infrastructure- and model-level approaches [17, 18]. However, optimizing a harness is difficult in practice. Since tool use, context management, verification, delegation, recovery, and termination are tightly coupled, a change that is locally beneficial may cause downstream failures or shift token costs to later stages of execution. In practice, harness development often requires substantial human effort to inspect long execution traces, identify recurring failure modes, and translate these observations into code changes. This process is costly and difficult to scale across tasks and environmen

Structure (section headings from HTML)

• SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness
• 1 Introduction
• 2 Method
• 2.1 Harness Auto-Research for Token Efficiency
• 2.2 Broad-to-Deep Harness Search
• 2.3 Search Environments
• Repository-derived environments.
• Verifier-driven environments.
• 2.4 Discovered Harness Mechanisms
• Action Fusion.
• Online Context Compact.
• ObservationPack.
• Evidence-Preserving Reducer.
• 2.5 Implementation Details and Backend Setup
• 3 Experimental Evaluation
• 3.1 Overall Comparison
• 3.2 Evaluation on Terminal-Bench 4 and IMO 2026
• 3.3 Efficient Agent Swarms
• 3.4 Learned Mechanisms and Backend Behavior
• Cache Reuse and Total Cost.
• 3.5 From Observation to a Retained Mechanism
• 4 Related Work
• 4.1 Agent Harnesses and Automated Agent Design
• 4.2 Automated Harness Optimization
• 4.3 Context and Token-Efficient Agents

Remainder

Full original English text: see html_url / source_url / pdf_url in frontmatter.