Before revision: We propose a doubly robust (DR) estimator for off-policy evaluation (OPE) from data obtained via multi-armed bandit (MAB) algorithms.
After revision: We propose a doubly robust (DR) estimator for off-policy evaluation (OPE) using dependent samples obtained via multi-armed bandit (MAB) algorithms.