upload function added to common.py crawler