Clean up the files produced by primer removal