usb: Associate a queue per endpoint