No need to check if ${LIBRARY} is defined.

We are already checking if ${${LIBRARY}} is a target, which
necessarily means that it has to be defined. Dereferinging an
undefined variable just results in an empty-string in cmake.