added scripts and data processing