Anthropic said it had migrated Messages API to Rust，CPU usage fell by approximately 40%to 50%
Dongcha Beating AI reported that Anthropic the platform engineering lead said the company had migrated Messages API from Python to Rust, and went fully live on September. They said that after the overhaul,CPU usage fell by approximately 40%to 50%, while first-token response latency improved by approximately 10%to 20%。