Note: body below is original English text extracted from arXiv abs / Atom. Do not treat this file as a translation.
arXiv:2609.01481 · published 2026-09-01
Abstract
This paper studies autonomous software development, in which LLM-based coding agents transform high-level requirements into complete, functional, and usable software systems without human intervention. We introduce Harness-of-Harness (HoH), a framework that enables coding agents to continually improve software during autonomous development. HoH operates on existing coding-agent harnesses, and organizes their executions into iterative planning-coding-testing loops. To sustain improvement across loops, HoH balances repair with capability growth, scopes development into small and verifiable increments, separates implementation-time testing from independent evaluation, and constrains verifiable outputs rather than prescribing agent workflows. It progressively exposes deliverables, role-specific tools, and skills, encourages reuse rather than recreation, and maintains versioned project histories. On GameCraft-Bench, FrontierSWE, and ProgramBench, three harness-model pairs (Codex with GPT-5.5, OpenCode with DeepSeek-V4-Pro, and Pi with MiniMax-M3), HoH consistently outperforms the corresponding standalone harnesses, achieving an average relative gain of 52.25 percent and a maximum gain of 82.86 percent after three iterations. In a multi-day deployment with more than 70 iterations, HoH autonomously develops a first-person-shooter game, featuring a coherent storyline, fully implemented core mechanics, human-playable experience, polished visuals and integrated audio. Github: this https URL Project Page: this https URL
Key claims (verbatim-leaning English extract)
- HoH wraps existing coding harnesses in iterative planning-coding-testing loops.
- Balances repair with capability growth; scopes verifiable increments; separates implementation-time testing from independent evaluation; constrains outputs not workflows.
- Progressive disclosure of deliverables/tools/skills; versioned project histories.
- Average relative gain 52.25% (max 82.86%) after three iterations across GameCraft-Bench, FrontierSWE, ProgramBench (Codex+GPT-5.5, OpenCode+DeepSeek-V4-Pro, Pi+MiniMax-M3).
- Multi-day >70 iterations autonomously develops a playable FPS game.
Remainder
Full original English text: see html_url / source_url / pdf_url in frontmatter. Do not invent missing sections from this partial extract.