now can process entire directories; added averages to _raw; added SPRS data to _correlated