Get rid of the inAdderClick logic

Instead of setting/resetting the inAdderClick flag,
we can just override mouseUp on the adder click,
and stop propagating.