first stage of edits to allow the code to do much larger scale data collection