Article

CertiK and Columbia University researchers have released TensorLean, achieving the world's first formal verification of production-level AI operators for DeepSeek and FlashAttention

BlockBeats reports that on November 21, CertiK announced the technical achievement of TensorLean jointly developed with Columbia University researchers, completing the world's first formal verification of production-level AI operators. This breakthrough enables mathematical proofs to be applied to real-world AI computation code that has undergone complex performance optimizations, providing model manufacturers with stricter correctness guarantees when improving training speed and reducing inference costs.

The research team evaluated 149 compiled instances within GPU repositories and verified through formal proof that 83 of them conform to the corresponding Lean specifications. This study covered GPU architectures across different generations and involved DeepSeek's DeepGEMM and the widely used FlashAttention operator library. The team discovered a total of 6 correctness issues across 38 libraries, including 2 in DeepGEMM and 23 in FlashAttention.

This research provides an example of applying formal verification to real-world AI computations. As large models continue to undergo performance optimization and hardware adaptation, underlying code also requires continuous adjustments. TensorLean allows developers to repeatedly verify correctness after code updates, helping reduce the risk of computational errors, rework during training, and wasted computing power.