Termsslug: on-policy-rl

On-Policy RL

同策略强化学习

RL paradigm requiring every action in an update to be generated and evaluated by the current policy.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Models
74 pts
Bitwise-Zero Train-Inference Mismatch Enables Stable On-Policy RL on TPU

To address the numerical mismatch between sampler and trainer that destabilizes LLM reinforcement learning, this work achieves bitwise-zero train-inference consistency on Cloud TPU. Modular kernel patterns and a three-way verification contract align policy evaluation across sampling and training, making the approach easy to adopt in existing multi-host JAX/TPU serving and training pipelines, with support expanding to linear attention and Mixture-of-Experts architectures.