OpenAI 官方博客T1·Models
78 pts
OpenAI Chief Scientist Jakub Pachocki argues that progress in modern AI is fundamentally progress in training better compressors, i.e. predictors, and proposes perplexity (cross-entropy loss) as a shared, cross-developer metric to inform common safety standards. As a first step, OpenAI discloses more transparency into its pretraining progress, and notes that recent models already show meaningful design contributions from AI itself.