adding main files for crawling (script file + aux functions file)