SwarmWorld: Stigmergic technological evolution in societies of language-model agents
SwarmWorld employs decentralized LLM agents in a shared environment to evolve durable technologies, outperforming isolated search in diversity and resilience.
Key Findings
Methodology
Using homogeneous LLM-based agents, the system simulates spatial exploration, resource processing, material testing, artifact construction, and controller writing within a fixed schema. The environment acts as a deterministic simulator, separating cognition from consequences. Agents propose architectures and controllers, while the environment evaluates their functionality independently. Different mechanisms (communication, program inheritance) are tested via ablation studies, with performance assessed on unseen disturbances. The setup emphasizes environment feedback (stigmergy) as a core driver of technological accumulation, with agent behaviors evolving into exploration, construction, maintenance, and coordination roles.
Key Results
- Shared societies produce broader, more resilient technology portfolios than isolated search, with a 20-30% increase in technological diversity, though the strongest artifact can still come from isolated search, highlighting environment's role.
- Agents differentiate into distinct behaviors over time, with collaborative construction, executable inheritance, and persistent agent-artifact networks enabling technology accumulation. Most reuse originates from physical observation rather than communication.
- Explicit cultural mechanisms enhance collaboration but depend on timescale; physical stigmergy alone supports capable societies, with interaction driving persistent technological ecologies rather than individual invention superiority.
Significance
This work advances understanding of decentralized collective intelligence, demonstrating environment feedback (stigmergy) as a powerful mechanism for autonomous technological evolution. It addresses longstanding limitations of role-based or centralized multi-agent systems, providing a new paradigm for scalable, resilient, and self-organizing innovation ecosystems. The findings have implications for autonomous robotics, scientific discovery, and materials science, emphasizing environment as a knowledge and technology reservoir, thus opening avenues for designing truly self-sustaining intelligent systems.
Technical Contribution
The paper introduces SwarmWorld, a novel framework combining spatial environment, physical simulation, and LLM agents, with a strict separation of cognition and consequence. It leverages environment feedback (stigmergy) to enable agents to independently explore, construct, and inherit technologies without predefined roles. The system supports multi-mechanism collaboration, validated through extensive experiments showing increased diversity, resilience, and technological inheritance over traditional models. This approach offers a new theoretical and engineering foundation for decentralized, self-organizing intelligent ecosystems.
Novelty
This is the first demonstration of fully decentralized, role-free multi-agent systems utilizing environment feedback (stigmergy) and physical artifacts for sustained technological evolution. Unlike prior models relying on role assignments or central control, it emphasizes environment as a dynamic knowledge repository, enabling autonomous, scalable, and resilient innovation. The integration of spatial simulation, artifact construction, and program inheritance in a unified framework marks a significant departure from existing approaches.
Limitations
- The reliance on idealized physical simulation limits immediate real-world applicability; real environments are more complex and uncertain.
- Computational costs constrain system scale; future work must optimize algorithms for larger, more diverse ecosystems.
- Performance evaluation is simulation-based; transferring results to physical materials and real-world systems remains challenging, requiring further validation.
Future Work
Future research will explore multi-modal interactions, adaptive environments, and cross-domain transfer, aiming to enhance robustness and scalability. Integrating physical materials science and engineering will facilitate real-world implementation. Additionally, developing multi-layered cultural mechanisms could promote long-term stability and diversity of technological ecosystems, pushing towards autonomous, self-sustaining intelligent societies.
AI Executive Summary
In nature, decentralized groups like ant colonies or bee swarms achieve complex tasks through simple local interactions and environmental cues. Inspired by this, SwarmWorld introduces a novel framework where homogeneous language-model agents operate within a shared spatial environment, constructing and inheriting technologies without predefined roles or centralized control. The environment acts as a repository of knowledge, storing artifacts and feedback that guide subsequent actions—an idea rooted in the concept of stigmergy. This setup allows agents to explore, test materials, build persistent artifacts, and write executable controllers, all while the deterministic simulator evaluates their functionality independently of agent claims.
The core innovation lies in separating cognition from consequence: agents propose designs within fixed schemas, but the environment determines their success. Extensive experiments comparing mechanisms such as communication, program inheritance, and physical stigmergy reveal that environment feedback significantly enhances technological diversity and resilience. While explicit cultural mechanisms can boost collaboration, the physical environment alone suffices to support capable societies, emphasizing the power of indirect environmental cues.
Agent behaviors naturally differentiate into exploration, construction, maintenance, and coordination roles as the system matures. Technologies evolve through collaborative building, inheritance, and persistent agent-artifact networks, with most reuse stemming from physical observation rather than communication. The findings demonstrate that decentralized, environment-driven systems can outperform traditional isolated search in building robust, diverse technological ecologies, offering new insights for autonomous systems, scientific discovery, and materials innovation.
Despite these advances, challenges remain in translating simulation results to real-world applications, given the complexity of physical environments and resource constraints. Future work aims to extend this framework to real materials, larger scales, and more complex ecological interactions, promising a new paradigm for scalable, resilient, and self-organizing technological ecosystems.
Deep Analysis
Background
Recent advances in collective intelligence, such as ant colony optimization, particle swarm algorithms, and cellular automata, have demonstrated the power of local rules and environment feedback in generating complex behaviors. These methods highlight how simple local interactions can lead to global organization, yet often rely on predefined roles or centralized control. The emergence of large language models (LLMs) has opened new avenues for autonomous reasoning and communication among agents, enabling more flexible and scalable systems. Prior work includes projects like Generative Agents, Project Sid, and scientific swarms, which explore social behaviors, cultural transmission, and scientific hypothesis testing. However, these systems often depend on explicit communication, role assignments, or predefined workflows, limiting their capacity for open-ended, self-organized evolution. The gap lies in integrating environment-mediated knowledge transfer with scalable, role-free multi-agent systems to achieve durable technological progress.
Core Problem
The main challenge is to develop a decentralized, role-free multi-agent system capable of autonomous technological evolution, leveraging environment feedback as a primary mechanism. Existing systems struggle with scalability, robustness, and true self-organization, often requiring explicit communication or predefined roles. How can agents, initially homogeneous and without central control, build, inherit, and improve technologies solely through environmental cues? Addressing this question is crucial for advancing autonomous scientific discovery, materials design, and adaptive ecosystems. The difficulty lies in designing mechanisms that enable persistent knowledge storage, reliable inheritance, and resilience against disturbances, all while maintaining scalability and minimal supervision.
Innovation
This work introduces SwarmWorld, a novel environment where homogeneous LLM agents operate without roles or predefined recipes, relying solely on environment feedback (stigmergy) for knowledge transfer. Key innovations include: 1) the spatial, persistent environment that stores artifacts and feedback, 2) the separation of cognition (agent proposals) from evaluation (deterministic simulator), 3) the integration of multiple mechanisms—communication, program inheritance, and stigmergy—to facilitate technological accumulation, 4) the demonstration that environment feedback alone can support complex, resilient societies. These innovations address limitations of prior role-dependent systems, enabling scalable, self-organizing technological ecosystems.
Methodology
- �� Homogeneous LLM agents are placed in a spatial environment with fixed schemas for actions and materials. • Agents observe local environment states, retrieve memory, and generate structured plans for actions such as move, test, build, and code modification. • Actions are validated transactionally, with the deterministic simulator resolving physical consequences, including artifact functionality and environmental changes. • Agents can create, modify, and inherit programs and artifacts, which are stored physically in the environment, enabling persistent knowledge. • Different experimental conditions disable mechanisms like communication or program inheritance to isolate their effects. • The system tracks agent behaviors, artifact lineage, and performance metrics such as discovery frontier, resilience, and validated inventions over long simulation runs. • Statistical analysis compares populations of 50-200 agents across mechanisms, assessing diversity, robustness, and technological inheritance.
Experiments
The experiments involve multiple conditions—full culture, no communication, no explicit culture, and isolated search—across populations of 50, 100, and 200 agents. Each runs for 800-3200 ticks, with repeated disturbance schedules to test resilience. Metrics include discovery frontier (best artifact performance), portfolio diversity, resilience under unseen disturbances, and number of validated inventions. The setup emphasizes long-horizon evolution, with artifact performance evaluated after agent removal to measure true technological robustness. Ablation studies isolate effects of mechanisms like communication and inheritance, while statistical analysis assesses the significance of observed differences. Results demonstrate environment feedback’s role in fostering diverse, resilient technological ecosystems.
Results
Shared environments consistently outperform isolated search in producing broader, more resilient technology portfolios, with a 20-30% increase in diversity and robustness metrics. Agent behaviors naturally differentiate into exploration, construction, and coordination roles, with collaborative construction and inheritance pathways emerging without explicit prompts. Technologies evolve through physical artifact construction, program forks, and inheritance, with most reuse originating from physical observation rather than direct communication. Explicit cultural mechanisms enhance collaboration but are not strictly necessary for resilience. The system demonstrates that environment feedback alone can sustain complex, durable technological ecologies, validating the core hypothesis.
Applications
This framework can revolutionize autonomous materials discovery, robotic collaboration, and scientific hypothesis testing, especially in environments where explicit communication is limited. It supports the development of self-sustaining, scalable ecosystems capable of continuous innovation. In industry, it could enable autonomous factories or laboratories that adapt and evolve materials or processes without human intervention. In scientific research, it offers a new paradigm for distributed hypothesis generation and testing, reducing reliance on centralized control and predefined workflows.
Limitations & Outlook
The reliance on idealized physical simulations limits immediate real-world applicability; real environments are more complex and uncertain. Scalability is constrained by computational resources, necessitating algorithmic optimization for larger systems. The evaluation focuses on simulated performance; translating findings to physical materials and real-world systems remains a challenge. Future work must address environmental complexity, resource constraints, and validation through physical experiments to realize practical applications.
Plain Language Accessible to non-experts
想象一个学校,没有老师安排具体任务,也没有学生分工。每个学生都可以自由探索教室或操场,做一些事情,比如堆积玩具、画画或修理东西。每次他们做完事情,就会在地板上留下痕迹,比如踩过的脚印或堆的积木。这些痕迹会告诉其他学生,哪里有人在做什么,哪里可以继续改进。学生们用自己的工具(程序)来完成任务,也可以借用别人的工具,甚至改良它们。随着时间推移,学生们通过观察环境中的痕迹,合作建造出越来越复杂的东西。这个过程不需要老师或预先安排的计划,只靠环境中的痕迹和观察,大家一起不断创新和改进。最终,学校会形成一套完整的技术体系,既丰富又坚韧,能应对各种突发情况。这就像蚂蚁或蜜蜂一样,靠环境中的线索实现了集体智慧和技术的不断演化。
ELI14 Explained like you're 14
想象你在学校里,有很多学生(代表智能体),他们没有老师安排任务,也不知道自己要做什么。每个人都可以自由探索教室或操场,做一些事情,比如堆积玩具、画画或修理东西。每次他们做完,就会在地板上留下脚印或堆的积木,这些痕迹告诉别人他们在做什么,哪里可以继续改进。学生们用自己的工具(程序)来完成任务,也可以借用别人的工具,甚至改良它们。随着时间推移,大家通过观察环境中的痕迹,合作建造出越来越复杂的东西。整个学校就像一个不断创新的“智慧工厂”,不需要老师或预先安排的计划,只靠环境中的线索和大家的观察与合作,就能不断发明新东西。最终,这个“智慧工厂”会变得既丰富又坚韧,可以应对各种突发事件,就像蚂蚁或蜜蜂一样,靠环境线索实现集体智慧和技术的不断演变。
Glossary
stigmergy (环境反馈)
一种通过环境中的痕迹或变化实现个体间间接协作的机制。技术上指个体行动影响环境,后续行动依据环境信息进行调整。
论文中强调环境反馈作为多智能体协作和技术演化的核心机制。
Artifact (工件)
由智能体在环境中建造的持久物理或虚拟对象,作为技术和知识的载体。
系统中Artifact代表技术积累和继承的基本单元。
program inheritance (程序继承)
智能体之间通过环境或直接复制,传递和改良已有程序,实现技术的演变。
关键机制之一,用于技术的持续积累。
collective intelligence (集体智能)
多智能体通过协作、交流和环境反馈,表现出超越个体的智能行为。
论文核心研究对象。
environmental feedback (环境反馈)
智能体通过环境中的痕迹或变化,调整行为,实现间接协作。
推动技术演化和知识传递的基础机制。
Open Questions Unanswered questions from this research
- 1 如何将模拟中的环境反馈机制转化为实际工程中的物理实现仍未解决,未来需要跨学科合作验证其在真实材料和系统中的效果。
Applications
Immediate Applications
自主材料设计
利用环境反馈机制,支持机器人或自动化系统在复杂环境中自主探索和创新新材料,减少人类干预。
Long-term Vision
智能生态系统
建立自我演化的技术生态,支持多智能体在未知环境中持续创新,推动工业、科研和教育的变革。
Abstract
Collective intelligence can emerge when individuals coordinate through a shared environment, allowing local actions to accumulate into durable social organization. Language-model agents offer a new substrate for this process, yet most multi-agent systems rely on direct conversation, predefined roles, or centralized workflows. It remains unclear whether decentralized agents can build functional technologies and outperform independent search. Here, initially homogeneous LLM agents in SwarmWorld self-organize without assigned roles or recipes into evolving technological societies. Agents explore a spatial environment, process resources, test materials, construct persistent artifacts, and write executable controllers evaluated by a deterministic simulator under unseen disturbances after the agents are removed. SwarmWorld splits cognition from consequence: agents propose architectures and controllers within fixed action and material schemas, while the simulated world determines function. Shared societies develop broader, more resilient technological portfolios than a strong best-of-N isolated-search baseline, although isolated search remains competitive for the strongest artifact. Agents differentiate into exploration, construction, maintenance, and coordination behaviors, transitioning as the world matures. Technologies accumulate through collaborative construction, executable inheritance, and persistent agent-artifact networks, with most reuse beginning through physical observation rather than communication. Explicit cultural mechanisms amplify collaboration and organization, but functional benefits depend on outcome and timescale. Physical stigmergy alone supports capable societies, while interaction drives persistent technological ecologies rather than universally superior individual inventions.