Handle mouse mouse drag-clicking correctly

Fix bug where dragging off of a control while clicking would register as
a click.