corrections to process new file and date format