Update regression test to use sites.csv
In progress tests rather than ratified.

Includes shell script for new job to run those in progress overnight.