If we don't right-click a villager, send an error. Remove the player from the list regardless of outcome.