Revert "Fixed GPIO support by adding GPIO clock"

This reverts commit 532fe7d6346a220c9f7b9422bbac580a5ede158e.
The changes should be implemented in the application ran on the second
CPU instead of the linux kernel.