Policy Lag

The version gap between the stale weights that generated rollouts and the current learner weights in async training.