When we fail to get a USB reference we should just return, because
there are no more references held.

MFC after:	3 days


git-svn-id: svn+ssh://svn.freebsd.org/base/head@272480 ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f