Fix for better error logging while crawling