fix some thread safe bugs, avoid of kicking timeout client out by mistake