Tidying up random directory that snuck in.
Now exits with non-zero status code if testing on a non-dev site.