Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup"""""""""""""""

This reverts commit 80d0f245f381493f6bd089920af75b9b2c29914a.