put logging settings logic into a method
remove logging settings in custom crawler