bmas

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
bmas [2026/06/19 15:44] – [Abstract] pedroortegabmas [2026/06/20 13:18] (current) – [Safe AI Should be Bounded and Multi-Agent] pedroortega
Line 1: Line 1:
 ====== Safe AI Should be Bounded and Multi-Agent ====== ====== Safe AI Should be Bounded and Multi-Agent ======
  
-**David Hyland, Daniel Jarne Ornia, Nicholas Bishop, Joel Dyer, Olivia Macmillan-Scott, Tomáš Gaveniak, Ani Calinescu, Michael Wooldridge, Fernando Rosas, Pedro Ortega**+**David Hyland, Daniel Jarne Ornia, Nicholas Bishop, Joel Dyer, Olivia Macmillan-Scott, Tomáš Gaveniak, Ani Calinescu, Michael Wooldridge, Fernando Rosas, Pedro A. Ortega**
  
 //Keywords: AI safety, bounded agency, multi-agent systems, modularity, verification, governance. // //Keywords: AI safety, bounded agency, multi-agent systems, modularity, verification, governance. //
Line 18: Line 18:
 BMAS starts from a different decomposition. A task induces a capability profile: reasoning, knowledge, coding, planning, tool use, verification, and communication may all be required in different proportions. Unsafe behaviour also has a capability profile. Risk is highest when the capabilities required for task completion and the capabilities required for harm are colocated in one agent. BMAS starts from a different decomposition. A task induces a capability profile: reasoning, knowledge, coding, planning, tool use, verification, and communication may all be required in different proportions. Unsafe behaviour also has a capability profile. Risk is highest when the capabilities required for task completion and the capabilities required for harm are colocated in one agent.
  
-The BMAS proposal is to design systems in which useful capability is distributed across bounded components. A planner plans. A retriever retrieves. A coder writes code. A verifier checks outputs. A monitor inspects interactions. An executor acts under controlled authority. The system becomes capable through composition, while each component has a restricted scope.+The BMAS proposal is to design systems in which useful capability is distributed across bounded components. A planner plans. A retriever retrieves. A coder writes code. A verifier checks outputs. A monitor inspects interactions. An executor acts under controlled authority. And so forth. The system becomes capable through composition, while each component has a restricted scope.
  
 ===== Bounded agents ===== ===== Bounded agents =====
  • bmas.1781883845.txt.gz
  • Last modified: 2026/06/19 15:44
  • by pedroortega