Termsslug: next-token-prediction

Next Token Prediction

Token 预测

Task of predicting the probability distribution of the next discrete unit based on preceding sequences.

Curated Intelligence

1 items · Page 1/1
OpenAI 官方博客T1·Models
68 pts
OpenAI Releases MuseNet: Multi-Style Music Generation via Transformers

OpenAI introduced MuseNet, a deep neural network capable of generating 4-minute compositions with 10 instruments and blending styles from country to Mozart. The model uses the same large-scale transformer architecture as GPT-2, learning harmony, rhythm, and style patterns by predicting the next token in hundreds of thousands of MIDI files without explicit musical programming.