Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup"""""""""""""""""""

This reverts commit 9fceddcca39fa57ec1469c8818f7dc109234cdb5.