Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup""""""""""

This reverts commit 9d0f1f5163d5ef94a6ec8d55dd1f55266337407a.