Fix removal of symlinks to directories