Termsslug: nystr-m-method

Nyström Method

Nyström 方法

An algorithm for low-rank approximation of kernel matrices or large symmetric matrices.

Curated Intelligence

1 items · Page 1/1
Hugging Face BlogT1·Models
45 pts
Nyströmformer: Linear-Time Self-Attention Approximation

Nyströmformer approximates self-attention in Transformers using the Nyström method, reducing time and memory complexity from quadratic to linear. The study employs low-rank matrix decomposition to significantly improve efficiency for long sequences while maintaining model performance.