Ant Group Open-Sources Humming for Quantized Inference

1 reports archived1 independent sourcesupdated 10/21/2026, 08:00:00

Synthesis & Latest Updates

1 Sources Cross-Validated

Ant Group and the vLLM community have open-sourced Humming, a high-performance kernel library for quantized inference. It supports NVIDIA and domestic chips, handles diverse weight/activation formats, and outperforms existing implementations like Marlin and FlashInfer on dense and MoE workloads.

LATEST/Ant Group and the vLLM community have open-sourced Humming, a high-performance kernel library for quantized inference. It supports NVIDIA and domestic chips, handles diverse weight/activation formats, and outperforms existing implementations like Marlin and FlashInfer on dense and MoE workloads.

HEAT TRENDHourly heat curve

3 fully observed hours

Now

16.8

Peak

17.813:00

24h change

–

The line compares only sources observed throughout; gap hours are interpolated to keep the trend continuous.

TIMELINECoverage timeline

Total 1 reports · Latest first

vLLM 官方博客T1·Oct 21, 08:0078 pts
Ant Group Open-Sources Humming for Quantized Inference
- Supports NVIDIA GPUs from Turing onwards and CUDA-compatible devices like T-Head Zhenwu 810E
- Unified architecture handles diverse integer/float quantization combinations for dense and MoE models
- Benchmarks show significantly better execution performance than vLLM Marlin, FlashInfer, and DeepGEMM
View Related Reports & Analysis Original Source