major update to preprocessing steps