minor improvements in crawler status info and parser content detection