Hacker News AIT2·78 pts
- Highlights that while LLMs follow scaling laws, they still heavily rely on hand-crafted encoding steps (e.g., tokenization).
- Proposes a hierarchical network architecture to learn abstract patterns directly from raw bytes instead of tokens.
- Emphasizes that in complex, data-scarce domains (like biology and robotics), general learning algorithms are more critical than human-engineered priors.