Before revision:  Based on the schemes, a new finite-time analysis of the Q-learning is given with a finite-time error bound.
After revision:  Based on the schemes, a new finite-time error bound of asynchronous Q-learning is given with a finite-time error bound.