Conditionally set logger and queue on mailer

Possible since https://github.com/laravel/framework/pull/4648
Merge pull request #5513 from alprs/fix/mailer-conditional-set

Conditionally set logger and queue on mailer