Revert "ASoC: pcm: Use the power efficient workqueue for delayed powerdown"

This reverts commit f1592f7fd65ff1eb47d50d3693509f6c9aab653e.