Fix require order so bin/collector correctly logs

Also raise in the logger if it is attempted to be used without being
configured first, so that future users don't get burned by misconfigured
logging.

[#53414435]