Revert "before setting self.logger to Rails.logger, check for Delayed::Worker.logger"

This reverts commit 3f0d4a0e73ba57a1612f4db3f00f037ac8f9964b.