Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup""""""""""""""""""""

This reverts commit 40a781b7c61358871f3d38b0e17c7a3c8d5eaec5.