Only pass TOOLCHAIN_FILE when specified.

Also don't pass the package path, since it's unnecessary. Avoiding
unused variables suppresses a CMake warning.