Microsoft reportedly completes MAI-Base-2 pretraining, with a parameter scale of 2800000000000
BlockBeats reports that Microsoft has completed pretraining of its self-developed model MAI-Base-2, which uses an MoE architecture and has now entered the post-training stage.