Note: body below is original English text extracted from arXiv abs / HTML. Do not treat this file as a translation.
arXiv:2609.11677 · published 2026-09-10 · code: https://github.com/cuiyu-ai/Ecdysis
Abstract
Self-evolving runtime harnesses can substantially improve the capabilities of large language model (LLM) agents and provide a promising paradigm for optimizing agent execution. Existing harness evolution methods typically rely on iterative search, repeatedly evaluating and revising candidate harnesses based on execution feedback from task instances. While this paradigm enables continuous harness optimization, it incurs substantial time overhead due to repeated agent executions and code modifications, and may overfit to observed tasks and specific failure patterns, resulting in degraded generalization to unseen tasks. We identify the lack of principled failure diagnosis as a key bottleneck in harness evolution: an observed failure can reflect either model-specific deficiencies or systematic harness deficiencies, and directly optimizing against individual failures can lead to unnecessary model-specific accommodation. We therefore propose Ecdysis, an efficient and effective framework that distinguishes model-specific accommodation from harness-level repair and biases adaptation toward systematic harness deficiencies by identifying recurring cross-task failure patterns. Ecdysis adopts a batch-level cross-instance failure aggregation paradigm to jointly analyze failure evidence from multiple task instances and further introduces Failure-Driven Collaborative Refinement (FDCR) to diagnose failure causes and iteratively refine harness modification specifications. By combining cross-instance failure analysis with multi-role diagnosis, Ecdysis enables more effective harness evolution with lower end-to-end training time. Experiments across multiple LLMs and benchmarks show that Ecdysis achieves up to a 1.84× speedup in harness training compared with existing harness evolution methods, while improving the reasoning accuracy of the resulting harnesses by 18.56%. Moreover, harnesses trained with Ecdysis exhibit stronger generalization across LLMs and reduce inference-time token consumption.
Key claims (verbatim-leaning English extract)
- Central distinction: failure may be model-specific accommodation vs systematic harness deficiency; individual failures give weak attribution signal.
- Batch-level cross-instance failure aggregation: prioritize failure groups covering ≥2 distinct tasks as stronger evidence for harness repair.
- FDCR roles: Analyst / Critic / Engineer refine proposals; Moderator emits structured modification specification; coding agent implements edits separately.
- Acceptance: candidate harness retained only if J_train(H^c) > J_train(H_{i-1}).
- Empirical: up to 1.84× training speedup vs Self-Evolution; +18.56% relative accuracy vs SE averaged across models/datasets; model-accommodation ratio t drops from 60.0% (SE) to 45.5% (Ecdysis).
- Data curation: failure-aware selection with 1/4 training failures can approach full-data performance; random 1/4 underperforms.
- Cross-model: harness evolved on Qwen3-8B transfers to other task models without further evolution (e.g. Qwen3-32B Airline 51.67%→68.33%).
- Code: https://github.com/cuiyu-ai/Ecdysis
Remainder
Full original English text: see html_url / source_url / pdf_url in frontmatter.