Remove unused directories.