Final product: Some modifications were made to improve efficiency but now it can only safely run on ~100 million sequences or ~60Gb files. Will fix this bug over christmas.