Implemented json file compression on every 1 million tweets. Compresses the json file, deletes it, and opens a new one. TODO: csv file writing. TODO: thread the compression as it will probably take some time on big files
Implemented json file compression on every 1 million tweets. Compresses the json file, deletes it, and opens a new one. TODO: csv file writing. TODO: thread the compression as it will probably take some time on big files
Merge pull request #5 from nickmalleson/master

JSON compression mostly done