added logging of duration; added pig script to consolidate v3 output.