Fix libusb subdirectory builds.
Revert "Unconditionally do the libusb subdirectory from configure.ac"

This reverts commit 8d2ac6f2cf5b6426ab3c5e4d3a9a3f49add9405b.