Remove entities when switching the server