Adding features for generating mockdata:
Did some checking on memory. Redis is handling itself nicely, only using 15MB for 10,000 lines of data, 1 million should be around 1.5 GB, so around that time we will start caring about a DB