alsa: Remove remnants of device switches