Excited to share that #
LatentMAS# has been accepted to ICML 2026 as a spotlight!
💻Code:
📄Paper:
We push multi-agent collaboration into the latent space — beyond human language.
Most multi-agent systems rely on text: agents reason in words, exchange messages, and repeatedly decode/re-encode information. But language can be slow, lossy, and unnecessarily constrained.
💡LatentMAS takes a different path: LLM agents reason and communicate directly through hidden embeddings.
No text decoding.
No extra training.
No token-level message passing.
Instead, agents collaborate through:
🧠 Autoregressive Latent Thoughts — hidden-state-level reasoning steps
🔁 Latent Communication — information sharing via KV-cache transfer
📌 Input-output Alignment — keeping latent representations in-distribution
🚀 Training-free Collaboration — plug-and-play with existing LLMs
Why it matters:
✅ Up to +14.6% better accuracy on complex reasoning tasks
⚡ 4-4.6x faster end-to-end inference
✂️ 70.8%–83.7% reduction in output token usage
A step toward multi-agent systems that collaborate not by speaking more, but by thinking together in latent space.
#
MultiAgentSystems# #
ModelCollaboration# #
LatentReasoning# #
LLM# #
AgenticAI# #
ICML#