Add config flag to cleanup comparison images

The motivation behind this is I do not want to keep the comparison images
around, all I really care for is the failure images. Also I wanted a solution
that works in parallel.