preliminary processing of rawdata