added raw data changes (includes all test and validation)