file processing and data cleansing