IT之家 · 智能时代T2·78 pts
- The Ternary Bonsai 2 series offers 2B, 4B, and 9B variants with storage as low as 0.43GB, optimized for mobile deployment.
- On iPhone 18 Pro Max, the 2B model achieves 120 tokens/s locally, while the 9B model reaches 34 tokens/s.
- Compared to full-precision models, the new series delivers up to 5x throughput and 3x energy efficiency on RTX 4090 and M5 Pro hardware.
- Model weights are open-sourced under Apache 2.0, supporting deployment via llama.cpp and MLX frameworks.