Ignoring errors from AhrefsBot TurnitinBot crawlers