buildsys: Only link to libusb when USB host driver is enabled

Signed-off-by: Alexandru Gagniuc <mr.nuke.me@gmail.com>