Before revision: We propose a cumulative oversampling (CO) technique for Thompson Sampling (TS)to construct optimistic parameter estimates with significantly fewer samples than existing oversampling frameworks .
After revision: We propose a cumulative oversampling (CO) technique for Thompson Sampling (TS)to construct optimistic parameter estimations that asymptotically concentrate around the true parameters as tighter upper confidence bounds compared to the ones constructed with standard UCB methods .