[WIP][SPARK-1720][SPARK-1719] use LD_LIBRARY_PATH instead of -Djava.library.path

This is another implementation about #1031
Why do you need to set the environment this way? Why can't you just add it to the command's environment the same way other places have been doing it (i.e. `environment.addVariables`)?