Before revision:  Based on the schemes, a new finite-time analysis of the Q-learning is given with a finite-time error bound.
After revision:  Based on these two systems, we derive a new finite-time analysis of the Q-learning is given with a finite-time error bound.