Delete the entire dir we created