Wipe empty directories, too.