Prevent user select on "button" elements

(e.g. rapidly clicking the X button next to an input would cause it to
be selected, even though that is not the expected button behaviour (as
it's just a div))