Ant Group and the vLLM community jointly open-source the Humming quantized inference library
PANews reports that Ant Group and the vLLM community have jointly open-sourced Humming, a general-purpose library of quantized inference operators, claiming that it supports multiple categories of GPU, quantization formats, and Dense and MoE models.