Fixed documentation for dependency
Decided to move parse method to the tokenizer, will have to rename it later
Fixed typo in metadata class
Updated todos
Updated documentation in several documents, as well as found orphan attributes
Updated todos and wrote documentation
Renamed tokenizer to something better
Splitting up collectionprocessor.process() into several methods
Simplified collectionprocessor.extract_record_metadata()
Cleaned up parts of collectionprocessor
We don't need usernames or passwords
Better imports
No need for a class in this module
Actually, a class is needed
Don't need these arguments for collectionprocessor
More work on collectionprocessor, small optimization in documentparser
Wrote parse_documents for collection_processor
Wrote calculate_index_sequences
Finished up process method of collectionprocessor
Removed placeholder variables