Revert "qcom-common: Enable CAF audio variant"

This reverts commit 22a9c684bf73187f07b740955a4d2c362e74f943.