Fix a issue where severe lag result in user disconnect.