Before revision:  Previous prioritization methods based on temporal-difference (TD ) errorare highly heuristic and divergent from the objective of RL . In this work, we analyze the optimal prioritization strategy that can minimize the regret of RL policytheoretically.
After revision:  Previous prioritization methods based on temporal-difference (TD ) errorare highly heuristic and divergent from the objective of RL . In this work, we start from the regret minimization objective, and obtain an optimal prioritization strategy that can minimize the regret of RL policytheoretically.