modified purge pipeline for manual clustering