Hacker News AIT2·74 pts
- LLLM adds a horizontal latent dimension to the vertical residual stream, forming a 2D latent lattice
- A 22-layer LLLM matches a 40-layer Transformer's validation perplexity with 45% smaller KV cache
- It composes with existing residual enhancements such as hyper-connections and a Jacobi refiner