Remove files dir which should be a symlink