Hugging Face BlogT1·Models
78 pts
ServiceNow AI released Apriel-H1, converting a 15B reasoning model into a Mamba hybrid architecture to achieve 2.1x throughput with minimal quality loss. The study highlights a non-obvious insight in distillation: the choice of training data is critical for balancing efficiency and performance, challenging common intuitions.