Termsslug: awq-4-bit-quantization

AWQ 4-bit Quantization

AWQ 4bit 量化

Activation-aware weight quantization compressing model weights to 4-bit to cut deployment memory.

Curated Intelligence

1 items · Page 1/1
IT之家 · 智能时代T2·Models
78 pts
SenseTime Open-Sources Loop-9B Model With 10 GB Deployment Footprint

SenseTime released and open-sourced SenseNova Loop-9B, which reuses shared intermediate layers to expand 32 physical decoder layers into 56 layer computations, approaching 27B-class performance at roughly 9B parameters. Its official AWQ 4-bit weights are about 4.9 GB with deployment memory under 10 GB, supporting 512K context and multimodal input to sharply lower private deployment barriers.