Note: body below is the original English paper, text-extracted from https://arxiv.org/html/2609.02094. Figure pixels are not preserved. Do not treat this file as a translation.

MASkills: Continual Skills Optimization for Multi-Agent LLM Systems

  Title:
  

  

arXiv:2609.02094v1 [cs.AI] 02 Sep 2026

MASkills: Continual Skills Optimization for Multi-Agent LLM Systems

Huaiyuan Yao   Xiaoou Liu   Charles Fleming   Tianlong Chen   Hua Wei

Affiliation: Arizona State University  {huaiyuan, xiaoouli, hua.wei}@asu.edu

Affiliation: Cisco Research  chflemin@cisco.com

Affiliation: University of North Carolina at Chapel Hill  tianlong@cs.unc.edu

Abstract

LLM-based multi-agent systems have shown strong performance on complex tasks, yet continual improvement from interaction experience remains challenging. Existing self-reflection methods build experience memories, but memories are mostly hard to invoke, refine, or scale, while agent skills offer a more actionable unit: structured procedural knowledge that specifies when to act, how to act, and which resources or tools to use. We introduce MASkills, a continual learning framework that optimizes multi-agent LLM systems through agent skills. MASkills presents a new agent-optimization pipeline that integrates skill-conditioned credit assignment, hierarchical credit aggregation, and momentum-smoothed optimization, enabling agent skill libraries to evolve through refinement, induction, consolidation, and pruning. Experiments on HotpotQA, LoCoMo, and GAIA demonstrate the effectiveness of MASkills across multiple agentic tasks. Our code is available at https://github.com/DaRL-GenAI/MASkills

1 Introduction

LLM-based multi-agent systems have emerged as a practical paradigm for solving complex tasks through coordination, role specialization, and long-horizon interaction [1, 2, 3]. However, how to continually improve a multi-agent LLM system over time remains challenging. Existing methods typically use self-reflection to construct an experience memory [4, 5]. Such memories can preserve useful experience, but they remain a weak basis for continual improvement: they record what happened in past trajectories, but not which action policy should be reused; they lack reliable invocation conditions; and as the memory grows, useful lessons become mixed with noisy, redundant, or stale free-form records [6].

A more useful unit for continual improvement is a skill. According to Anthropic [7], a skill is a structured package of procedural knowledge that tells an agent how to perform a class of tasks, including when to invoke it, how to act, which resources or tools to use. Skills make experience reusable: agents can discover relevant skills from lightweight descriptions, load detailed instructions and resources on demand, and refine them as new experience accumulates. This progressive-disclosure design makes skills more scalable and actionable than large unstructured memory stores. Recent methods [8, 9, 10] develop such reusable procedural abstractions, but remain predominantly single-agent and do not optimize skills under the coordination dynamics that determine team-level utility in multi-agent systems.

Remainder

Full original English text: see html_url / source_url in frontmatter (do not invent from this preview).