Only start up the cleanup threads if we're not adding a job - which returns instantly