Scale Labs Benchmark finds 25 multimodal models lag behind humans in common-sense understanding
Beating AI reports that Scale Labs and Elorian released the HSS benchmark, and that 25 multimodal models all scored below human participants in tests of understanding implicit information in images and videos. The report also states that increasing reasoning effort and using image-inspection Agents helped, but did not close the gap.