Being a little more manual with what we run during tests

That way when we start writing out templates, we don't accidentally
write a bunch of files for each spec we don't run in a temp dir