Only set relativenumber if number was on