Improved sampling strategy for epsilon-greedy exploration