Article
DeepSeek and Huawei Join Forces to Challenge Nvidia AI Computing-power hegemony: participating in next-generation chip design, racing to begin pre-training on domestic chips by year-end
Beating News AI breaking news: Last year, DeepSeek attempted to train using Huawei Ascend chips R2, but ultimately failed. The Financial Times reported at the time that there were issues with chip stability, inter-card communication, and software support. Even with Huawei engineers providing on-site assistance, DeepSeek ultimately switched back to Nvidia chips to complete training. 1 More than a year later, the two sides' collaboration has further deepened into hardware design. The Information now reports that Huawei engineers have been stationed at DeepSeek's offices for extended periods, directly incorporating practical model-training requirements into the design of next-generation Ascend chips, including how to schedule computing tasks and transfer data between chips.
This year, DeepSeek September recently open-sourced the Ascend version of TileLang, as well as underlying tools for matrix computing, MoE expert communication, and more, reducing the development work required to migrate models to domestic chips. But getting the software running is still a long way from full pre-training. Tens of thousands of chips must work continuously in coordination for weeks; a failure in any one chip, or a delay in data transmission, could slow the entire cluster. The two sides are now addressing these issues from the chip-design stage.
Huawei plans to prioritize most of the supply of Ascend 2027 expected to be ready in the first quarter of 960DT for DeepSeek, rather than distributing it among other model companies. DeepSeek, in turn, is preparing to begin pre-training with 950DT as early as the end of this year. Relevant testing has currently used more than 1000 chips; full pre-training may require tens of thousands of chips, and some cluster-management software has yet to be completed. Meanwhile, DeepSeek is still seeking more Nvidia chips.
Original link https://m.theblockbeats.info/flash/372713