ALSA: usb-audio: Avoid autopm calls after disconnection