ASoC: wcd9304_m4: unconditionally switch tx ports

Kconfig part of this change got dropped when merging, resulting in a
dead mic on m4.

Change-Id: I8079c6e2e977114e8643b2e6a6edced6bfeccb3a