Termsslug: compressor

Compressor

压缩器

The view of a model as compressing data into shorter representations, equivalent to a predictor and a framework for understandin

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Models
78 pts
OpenAI Chief Scientist Proposes Perplexity as Shared Safety Metric

OpenAI Chief Scientist Jakub Pachocki argues that progress in modern AI is fundamentally about training better compressors, i.e. predictors, and proposes perplexity (equivalently cross-entropy loss) as a comparable metric across model developers to underpin shared safety standards. He also pledges more transparency into OpenAI's pretraining progress and notes that recent models already show meaningful design contributions from AI.