Ingest, clean, trim, deduplicate twitter streams harvested with Twitter Archivist