Remove vbus wake up call and fix remaining usb issues

Change-Id: Ifcb07debd3979061902136f82a70e6beaf926e3c