configure: Don't set LD_LIBRARY_PATH when cross-compiling

Most of LD_LIBRARY_PATH adjustments are already guarded, but not all.

The patch fixes cross-compilation failure when libidn is present.