ported crawler over to python 2.7
reduced logging