Fix the bug that the num remain still