updated the raw processing script to skip directories that have already been processed