Revert "ASoC: msm: qdsp6v2: Propagate device HW delay to AFE."

This reverts commit 8bbba2ab868fa65e24bfb41d026267d56392af23.