Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "Revert "usb/usb3503: add back the gpio direction setup""""""""""""

This reverts commit 397ff37cb71583cfb95829300d576385ef3dcce3.