Revert "ASoC: add missing updates from CAF"

This reverts commit aedb56e10e4bcca56cf7e4b739e7ed61cde2dd07.