Remove the directory itself too.
Added assertions.