Fix the bug in AckProcessor of removing the only one server.