audio-caf: Don't build extensions that need QCOM proprietary source

Change-Id: Ifc588cbb9717890fe3f359bc207eb5f271603551