Article
Luo Fuli:MiMo-V2.6 or completed one of the largest single reinforcement learning training runs in the open-source model space
PANews September 22 news, Xiaomi MiMo team member Luo Fuli wrote that MiMo-V2.6 by compute scale, this may be one of the largest single reinforcement learning training runs conducted by an open-source model team to date. Despite constrained computing resources, the team committed dozens of people and advanced reinforcement learning scaling over an extended period. Model capabilities took shape during the mid-training stage and were further unlocked through large-scale reinforcement learning. She said that, for medium-difficulty verifiable tasks such as coding, the team uses MixRL MOPD training; tasks that are difficult to verify, have extremely long horizons, or are overly complex are trained separately, and then MOPD MixRL is used to combine capabilities. To advance research on agent reinforcement learning, the team also released a Qwen model distilled from MiMo reinforcement learning trajectories, 7000 diverse environments, and a complete reinforcement learning training framework. Luo Fuli stated that MiMo-V2.6 MiMo-V2.6 is only the starting point, and the team will continue...
(Click the link below to read the full article) 🔗https://www.panewslab.com/zh/articles/01a0c87a-f732-71f7-8d45-45465db6d9d6