processes raw context data with encodings, produces formatted data ready for training