raw data from NID and code for the initial cleanup