added daily data generation and processing test