PANews, citing CCTV reports that AI Multi-agent systems may develop internal communications that are difficult to interpret
BIBIBI
AT A GLANCE
The report says that multi-agent systems may develop internal communication methods that are difficult to interpret, raising governance concerns.
Article
AI Multi-agent systems evolve a human-unintelligible “dialect,” raising governance concerns
PANews September 26 reports, citing CCTV International Current Affairs, that a U.S.AI laboratory found, while testing multi-agent collaboration in a virtual “society” environment, that these agents spontaneously simplify grammar and create metaphors to improve communication efficiency and conserve computing power, gradually developing a “dialect”-like communication system that is difficult for humans to translate directly. The research indicates that when multiple AI agents interact over the long term in a closed system, they may transform formerly clear instructions and concepts into symbols understandable only internally—for example, converting a “ledger” into a warning signal—thereby undermining human interpretability and regulatory capacity. The report believes this trend means that current AI systems face a potential risk of “partial loss of control,”AI and that the development of governance and international collaboration standards urgently needs to be accelerated.
PANews reports that a U.S.AI laboratory tested multi-agent collaboration in a virtual “society” environment.
02
The report says that, to improve communication efficiency and conserve computing power, agents simplify grammar and create metaphors.
03
The report says that when multiple AI agents interact over the long term in a closed system, they may develop symbols understandable only internally.
04
The report gives the example that a formerly clear “ledger” may be converted into a warning signal.
05
The report believes this may undermine human interpretability and regulatory capacity, and says that current AI systems face a potential risk of “partial loss of control.”
AI-assisted interpretation
The following is analysis, separate from reported facts. Verify important claims independently.
Simply put, when multiple AI agents work together, they may gradually use forms of expression that humans do not easily understand in order to communicate more efficiently. This increases the difficulty for humans in understanding and regulating their behavior.
Why it matters to readers
If AI communication among them is difficult for humans to interpret, supervisors may find it harder to assess their instructions and collaboration processes. The report therefore calls for accelerating the development of AI governance and international collaboration standards.
This indicates that when using multiple AI agents collaboratively, attention should be paid not only to outcomes, but also to how they communicate and whether humans can understand and supervise that communication.
Risks and unknowns
The information is relayed by PANews from CCTV International Current Affairs; the name of the U.S.AI laboratory was not provided.
No research paper, testing methodology, specific results, or original materials were provided as evidence.
“Partially out of control” is a judgment in the report and cannot, on that basis, confirm that a specific risk event has occurred.
The evidence does not indicate whether this mode of communication commonly exists in real-world systems.
Related Developments
Loading event timeline…
Related concepts
Multi-agent systems
This term is not in the glossary yet. Browse related concepts in the glossary.