removing process_revision.
extracting _process_one_file
refactor crawler
converting process_file result to list of tuples for easier sql processing
process sql data