Before revision:  We propose new contextual bandit designs, combining parametric and non-parametric statistical estimation methods with causal inference methods in order to reduce the estimation biasthat results from adaptive treatment assignment .
After revision:  We propose new contextual bandit designs, combining parametric and non-parametric contextual bandits that integrate balancing methods from the causal inference literature in their estimation to make it less prone to problems of estimation bias .