Remove the directory structure