added cluster clean up, hopefully can now go over noisy data without huge mem us