If we've already symlinked a directory, do nothing