[WIP][SPARK-1720][SPARK-1719] use LD_LIBRARY_PATH instead of -Djava.library.path

- [X] Standalone
- [X] YARN 
- [X] Mesos
- [X]  Mac OS X
- [X] Linux 
- [ ]  Windows
 
This is another implementation about #1031
Do you need to escape the paths? What if there are spaces in the directory names? What I mean is:
```
LD_LIBRARY_PATH="path with space:path2:$LD_LIBRARY_PATH"
```
as opposed to
```
LD_LIBRARY_PATH=path with space:path2:$LD_LIBRARY_PATH
```