Fix prevent send number from server which the client just have returned room