Article
Datadog Zhipu GLM training and operations AI:90 fault evaluation tasks 80 tasks, and GPT-6 Astra tied
Beating AI breaking news, U.S. monitoring software company Datadog has launched its first dedicated operations model, Scout 1.0, built on Zhipu's open-source GLM-5.3 Flash.
It is specifically responsible for troubleshooting online system failures. It can query logs, monitoring metrics, and service call chains, and progressively identify the root cause of failures.Datadog built a simulated environment using real incidents and monitoring data, then trained the model through reinforcement learning so that it could learn to eliminate misleading clues and support diagnostic conclusions with evidence.
Among the 90 fault-troubleshooting tasks in the public SREGym benchmark,Datadog reported that Scout at its highest reasoning level completed 80 diagnoses and repairs, tying GPT-6 Astra xhigh and falling short of GPT-6.1 Sol xhigh by just 2 tasks. The original GLM-5.3 Flash completed 66 tasks.
In Datadog's internal AlertEval evaluation, the diagnostic quality of Scout's mid-level setting was close to that of GPT-6.1 Sol high and Claude Opus 5.5 high, while its estimated reasoning cost was only 3 to 8 times lower. Compared with GPT-6 Astra medium, the cost was approximately 19 times lower.
Scout has been integrated into Datadog's Bits Investigation and is currently available only to a small number of customers in a closed preview. At this stage, it is mainly responsible for determining the cause of failures and proposing recovery recommendations; automatically executing repairs remains a future research and development goal.
Original link https://m.theblockbeats.info/flash/372284