Updated crawler functions and slightly changed status file format