Hacker News AIT2·68 pts
- Key innovation involves freezing EmbeddingGemma 2's audio encoder and training only a small 'reader' to map audio features into the shared text embedding space, avoiding full model retraining.
- Extreme performance optimization: Achieves 288x real-time speed (1 hour of audio in 12.6 seconds) on a base M3 MacBook Air with 8GB RAM by leveraging the Apple Neural Engine.
- Privacy and deployment advantages: The model is only 715 MB, runs fully offline, and supports global hotkey dictation, ideal for privacy-sensitive low-compute terminal scenarios.