Added http response handling to Javascript crawler + minor bugfixes