crawler config uses hour, nocomment detector sevice,footer links