[WIP][SPARK-1720][SPARK-1719] use LD_LIBRARY_PATH instead of -Djava.library.path

- [X] Standalone
- [X] YARN 
- [X] Mesos
- [X]  Mac OS X
- [X] Linux 
- [ ]  Windows
 
This is another implementation about #1031
Any reason to move these here? I'm fine with keeping these here but I'm just curious if this is functionally different in any way.