ASoC: audio: Fix BE not disconnected even codec teardown