Revert "omap4-common: fix wake on unplug"

This seems to cause SODs.

This reverts commit 9805968b21d58023668553219a50931900c567b6.

Change-Id: I2cfbf44311dbe8b275679f976c592cb66667b2ae