Fix incorrect logic.

If we **are** putting links as annotations, then put the link as an
annotation.