Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup"""""

This reverts commit dea070a7d093cf223c9816932d914abc59b081b4.