text: We propose a family of non-uniform sampling strategies to provably speed up a class of stochastic optimization algorithms with linear convergence including [[ Stochastic Variance Reduced Gradient -LRB- SVRG -RRB- ]] and << Stochastic Dual Coordinate Ascent -LRB- SDCA -RRB- >> .