Before revision:  We explore how contextual banditsproblem is modelled as an extension of the reinforcement learning (RL) problem and build a novel algorithm to solve the problem using an array of action-based learners.
After revision:  We explore details on contextual bandits, an extension to the traditional reinforcement learning (RL) problem and build a novel algorithm to solve the problem using an array of action-based learners.