Apple Machine Learning ResearchT1·Models
68 pts
Strengthening language discrimination during pretraining significantly narrows the performance gap between multilingual and monolingual speech models. Interventions like auxiliary classifiers and per-language clustering targets improved HuBERT's phonetic, lexical, and prosodic metrics, with early-stage application yielding the best results.