Added crawler option to main.py