Also check for previousKeyboardFocus and previousScrollFocus before cancelling a focus change