When losing audio focus, do not let pause() cancels the audioFocusListener; otherwise, still let it cancel.