Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup""""""

This reverts commit 1d25c4d9873c3d5856219726d76286afaf365cdf.