Revert "ASoC: pcm: Use the power efficient workqueue for delayed powerdown"

This reverts commit 041252aa7d242925beeb7a3fb4d3298b29f2a8bc.