Revert "inappropriate check"

This reverts commit b4f162f7a958e001288bfe6c25fe914821939ffa.
Revert "Add hacky workaround for double list removal race in libusb"

This reverts commit e40c5f61d80a3e87974294b483eecd7366285b8f.