smdk4412: audio: Remove hackaround for broken audio in first call

It's not needed anymore.

Change-Id: If8e15afa41bd328732e7c77f2d2027c310a9cc2c