Article

Qwen4-Max closes in on Kimi: 3 points behind overall, 11% lower cost, but programming gap remains significant

Dongcha Beating AI flash news: Independent evaluation agency Artificial Analysis has released the official scores for Qwen4-Max. At the highest xhigh reasoning tier, the model achieved a comprehensive intelligence index of 43 points, up 9 points from the previous generation Qwen3.8-Max's 34 points, and 3 points behind Kimi K3.1 Pro's 46 points.

Qwen4-Max surpassed its predecessor in all 9 evaluations. The accuracy rate on the high-difficulty knowledge reasoning test HLE-Diamond increased from 24% to 45%, and the enterprise software automation test improved by 17 percentage points. In AA-Briefcase, which simulates real business document processing, Qwen4-Max scored 1686 Elo, slightly higher than Kimi K3.1 Pro's 1674.

Programming capability remains a weakness. In the Terminal-Bench 4.0 test, Qwen4-Max scored 48%, significantly behind Kimi K3.1 Pro's 67%. In FrontierCode 2.0, which assesses real open-source project development capabilities, both scored 26%, behind Tencent Hy4's 31%.

In terms of cost, Qwen4-Max's average cost per task is 3.27 USD, down from the previous generation's 10.02 USD, a decrease of about 67%, and about 11% cheaper than Kimi K3.1 Pro's 3.68 USD.

In addition to API price reductions, the model itself has also reduced Token consumption. Qwen4-Max outputs an average of about 105000 Tokens per task, a 39% decrease from the previous generation's 171000. However, Kimi K3.1 Pro only requires about 72000 Tokens.