Hacker News AIT2·Open Source
71 pts
The open source LookAtMyQuant project introduces a post-training quantization compiler that allocates bit budgets per stored unit based on measured output damage, using Fisher information and trellis codes. Its second version compresses Qwen3.5-4B to 1.23 GB (~2.3 bits per weight), solving 330 of 540 exact-answer math problems versus 328 for the same-size Bonsai 2 Ternary 4B, with lower KL divergence (0.45 vs 0.59 nats). The full recipe and roughly $34 of GPU cost are published under the MIT license.