Get rid of old directory with same case folding