Artificial Analysis (@ArtificialAnlys)T1·72 pts
- SubQ Snap 1.1 scores 65 on the AA Decision Index, tying with d1-ultra and Elephant 9B, leading the next competitor by 8 points.
- Key differentiator is low hallucination: 86% non-hallucination rate (second only to Elephant 9B), achieved by choosing 'I don't know' when uncertain.
- Performance trade-off: Lower accuracy (20% vs 32% for d1-ultra) but significantly larger context window (384K vs 32K/16K).
- Cost efficiency: ~$30 per 1M tasks, comparable to d1-ultra ($32) but ~3.6x more expensive than Elephant 9B ($8.4).