Before revision:  Our theory suggests that the data with higher  TD error, better on-policiness and more corrective feedback should be assigned with higher weights during sampling.
After revision:  Our theory suggests that the data with higher hindsight TD error, better on-policiness and more corrective feedback should be assigned with higher weights during sampling.