Thinking a bit more, we have two options here:

(a) make a backwards incompatible change here and people have to re-write there jobs
(b) continue supporting shipping SPARK_JAVA_OPTS from the driver to the executors for the entire 1.X family of Spark releases (e.g probably years).

I guess we can do (a) but I might give a loud error message here so that users change this.