Create and delete spec/tmp/ as needed