Ignore mousedown when not focused.