SkillAA: Attribution-Guided Skill-Graph Updating with Targeted Validation and Rollback
Note: body below is original English text extracted from arXiv abs / HTML. Do not treat this file as a translation.
arXiv:2609.20455 · published 2026-09-17 · submitted 17 Sep 2026
Abstract
External skills provide domain procedures without parameter updates, but existing methods often edit skills directly from failed rollouts without structured routing from an observed failure to an editable location; existing skill graphs also underuse semantic boundaries, object addresses, and topological dependencies for skill retrieval, targeted updating, and scoped validation. We introduce SkillAA (Skill Abductive Attribution), a structured skill-optimization framework for frozen language models. It represents skill applicability, execution, and composition in a unified graph, allowing the same structure to support skill selection, attribution-guided repair, and update validation. SkillAA contrasts successful and failed executions to route candidate repairs to specific graph objects, updates only the selected local structure, and uses Local and Big Gates to screen candidate changes before commitment. With gpt-5.6-sol, SkillAA reaches 81.5%, 66.7%, and 91.2% on SearchQA, LiveMath, and DocVQA, respectively, and attains the highest observed mean in every main setting. These results support the utility of attribution-guided graph editing and graph-scoped validation.
Authors
Ziqiao Shang, Ling-Yue Ge, Lan-Zhe Guo
Key claims (verbatim-leaning English extract)
External skills provide domain procedures without parameter updates, but existing methods often edit skills directly from failed rollouts without structured routing from an observed failure to an editable location; existing skill graphs also underuse semantic boundaries, object addresses, and topological dependencies for skill retrieval, targeted updating, and scoped validation. We introduce SkillAA (Skill Abductive Attribution), a structured skill-optimization framework for frozen language models. It represents skill applicability, execution, and composition in a unified graph, allowing the same structure to support skill selection, attribution-guided repair, and update validation. SkillAA contrasts successful and failed executions to route candidate repairs to specific graph objects, updates only the selected local structure, and uses Local and Big Gates to screen candidate changes before commitment. With gpt-5.6-sol, SkillAA reaches 81.5%, 66.7%, and 91.2% on SearchQA, LiveMath, and DocVQA, respectively, and attains the highest observed mean in every main setting. These results support the utility of attribution-guided graph editing and graph-scoped validation.
SkillAA represents skill applicability, execution, and composition in a unified graph supporting selection, attribution-guided repair, and update validation.
Abductive attribution contrasts successful and failed executions to route candidate repairs to specific graph objects and updates only the selected local structure.
Local Gate performs graph-scoped retesting; Big Gate performs epoch-level commit; patches can return NO_PATCH when the failure is an execution lapse or insufficient evidence.
With gpt-5.6-sol, SkillAA reaches 81.5%, 66.7%, and 91.2% on SearchQA, LiveMath, and DocVQA, respectively, and attains the highest observed mean in every main setting.
with Targeted Validation and Rollback # SkillAA: Attribution-Guided Skill-Graph Updating with Targeted Validation and Rollback
Figure 1: From failed rollouts to targeted skill repair. Existing skill systems can organize and compose reusable procedures, but a failed rollout alone does not reveal whether the candidate repair should address a trigger, execution step, exclusion boundary, skill relation, or one-off execution lapse. SkillAA contrasts successful and failed evidence to select a candidate graph object, edits only that location, and retests affected skills and cases. Rejected candidates are rolled back to the original plan, while validated repairs are retained for subsequent tasks.
Frozen language models increasingly rely on external tools, documents, workflows, and skills to solve tasks (Schick et al., 2023; Patil et al., 2023; Qin et al., 2023). These skills are readable, portable, and parameter-free, but reliable improvement requires knowing when they apply, how they interact, where failures arise, and whether an edit causes regressions.
Skill research has moved from independent retrieval toward relation modeling. SkillRouter selects skills using query–skill similarity and skill-body signals (Zheng et al., 2026). Graph-of-Skills retrieves prerequisite-aware bundles (Liu et al., 2026), while SkillDAG, HyperSkill, CaSKG, and SkillGraph learn relations from experience or encode higher-order, causal, and policy-coupled composition (Bai et al., 2026; Xu et al., 2026; Li et al., 2026c; Li et al., 2026b). These methods show the value of structured relations, but use graphs mainly for selection and composition: node semantics do not specify edit targets, and topology does not determine retest scopes or rollback units.
Skill-evolution methods distill experience, workflows, and skills from execution (Zhao et al., 2023; Wang et al., 2024; Ni et al., 2026); ProTeGi, TextGrad, and GEPA optimize linguistic artifacts from scores and trajectory feedback (Pryzant et al., 2023; Yuksekgonul et al., 2024; Agrawal et al., 2025); and SkillOpt optimizes a persistent skill document through bounded edits and Gates (Yang et al., 2026). However, they still lack structured object-level edit routing from failed executions. Flat text mixes activation conditions, procedures, exceptions, and relations, so the same failure may reflect missing knowledge, failed activation, a faulty procedure or relation, or a one-off execution lap
Structure (section headings from HTML)
- SkillAA: Attribution-Guided Skill-Graph Updating with Targeted Validation and Rollback
- 1 Introduction
- 2 Related Work
- Graph-structured skills.
- Skill evolution and controlled optimization.
- 3 Method
- 3.1 Problem Definition, Setting, and Framework Overview
- 3.2 Structured Skill Graph and Semantic Activation
- 3.3 Abductive Attribution and Targeted Graph Updates
- 3.4 Two-Level Gates: Local Rollback and Epoch Commit
- Local Gate: graph-scoped retesting.
- Big Gate: epoch-level commit.
- 4 Experiments
- 4.1 Experimental Setup
- Questions.
- Models.
- Benchmarks.
- Metrics and repeated evaluation.
- 4.2 Main Efficacy and Progressive Ablation
- 4.3 Comparison with Existing Methods
- 4.4 Component Ablations and Mechanism Analysis
- Graph structure ablation.
- Retrieval mechanism ablation.
- Update mechanism ablation.
- Teacher-transfer test.
Remainder
Full original English text: see html_url / source_url / pdf_url in frontmatter.