13 aug feature
attempt to account for corrupt data again