Revert "ASoC: msm: Fix issues in proxy port driver due to early afe port enable."

This reverts commit 52775d834da9bf4ce09460935109bde80696cb8a.

Conflicts:

	sound/soc/msm/msm-pcm-afe.c

 Author:    Steve Kondik <shade@chemlab.org>
	modified:   sound/soc/msm/msm-pcm-afe.c