Tested and fixed the cURL crawler, so that's working now.