Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup""""""""""""""

This reverts commit 8aa1458eaa3eedd1183731fef31a60e71653ef26.