It depends on how well-defined your company’s dress code is. If you think being unbuttoned seems too casual, play it safe and button at least the bottom one. Traditional wear for a polo includes leaving the top one or two buttons undone, though this may not be appropriate for every office.