added raw data processing