Termsslug: linear-complexity

Linear Complexity

线性复杂度

Complexity characteristic where runtime or memory grows linearly with input size.

Curated Intelligence

1 items · Page 1/1
Hugging Face BlogT1·Models
45 pts
Nyströmformer: Linear-Time Self-Attention Approximation

Nyströmformer approximates self-attention in Transformers using the Nyström method, reducing time and memory complexity from quadratic to linear. The study employs low-rank matrix decomposition to significantly improve efficiency for long sequences while maintaining model performance.