Workaround for crash when unplugging OTG devices.

Just always disable the IRQs instead of checking with dev which causes a crash upon device retrieval.