[WIP][SPARK-1720][SPARK-1719] use LD_LIBRARY_PATH instead of -Djava.library.path

This is another implementation about #1031
We shouldn't try to merge these two. We should let the conf one override the environment variable one. More generally, I think the ordering should be:
```
Spark submit argument > conf value > environment variable
```