Termsslug: rnn

RNN

循环神经网络

A neural network architecture with internal memory states capable of processing sequential data.

Curated Intelligence

4 items · Page 1/1
Hacker News AIT2·Models
68 pts
Quanta Analysis: How Attention Mechanisms Evolved from Bahdanau's 2014 Prototype to Transformer Core Math

The article traces the historical origins of the attention mechanism as the cornerstone of modern AI, analyzing how Dzmitry Bahdanau's 2014 neural machine translation model broke traditional bottlenecks. It elucidates via a mathematical perspective why this mechanism supports large-scale language processing, revealing the logical evolution from simple weighted sums to the core of the Transformer architecture.

Hugging Face BlogT1·Models
35 pts
RWKV: An RNN with Transformer Advantages

The RWKV project introduces a novel architecture combining the linear inference efficiency of RNNs with the parallel training advantages of Transformers. It aims to address the scalability and memory limitations of existing models, offering a new paradigm for long-sequence processing.

OpenAI 官方博客T1·Models
78 pts
RL²: Fast RL via Slow Learning in RNNs

OpenAI introduces RL², a framework that encodes a 'fast' reinforcement learning algorithm into the weights of a Recurrent Neural Network (RNN). By training this RNN with a general-purpose 'slow' RL algorithm across many tasks, it gains cross-episode memory, enabling rapid adaptation to new environments. Experiments demonstrate effectiveness on multi-armed bandits and large-scale visual navigation.