semvec/pypi-packages huggingface dataset:
pyrailgun 0.26
Fast Crawler For Python
License: MIT

This is a simple python crawler framework for human

you can crawler website more easily

only need a json file to descrip your crawler


optional module: webkit

if you have PyQt4 And QtWebkit installed, you can specific to use webkit to crawler html after javascript rendered

see https://github.com/princehaku/pyrailgun/tree/master/demo for some demos

see https://github.com/princehaku/pyrailgun for more infomation