[HOTFIX] Wait for EOF only for the PySpark shell

In `SparkSubmitDriverBootstrapper`, we wait for the parent process to send us an `EOF` before finishing the application. This is applicable for the PySpark shell because we terminate the application the same way. However if we run a python application, for instance, the JVM actually never exits unless it receives a manual EOF from the user. This is causing a few tests to timeout.

We only need to do this for the PySpark shell because Spark submit runs as a python subprocess only in this case. Thus, the normal Spark shell doesn't need to go through this case even though it is also a REPL.

Thanks davies for reporting this.

Author: Andrew Or <andrewor14@gmail.com>

Closes #2170 from andrewor14/bootstrap-hotfix and squashes the following commits:

42963f5 [Andrew Or] Do not wait for EOF unless this is the pyspark shell
(cherry picked from commit dafe343499bbc688e266106e4bb897f9e619834e)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
[HOTFIX][SQL] Remove cleaning of UDFs

It is not safe to run the closure cleaner on slaves.  #2153 introduced this which broke all UDF execution on slaves.  Will re-add cleaning of UDF closures in a follow-up PR.

Author: Michael Armbrust <michael@databricks.com>

Closes #2174 from marmbrus/fixUdfs and squashes the following commits:

55406de [Michael Armbrust] [HOTFIX] Remove cleaning of UDFs
(cherry picked from commit 024178c57419f915d26414e1b91ea0019c3650db)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
HOTFIX: Don't build with YARN support for Mapr3
[maven-release-plugin] prepare release v1.1.0-rc1
[maven-release-plugin] prepare for next development iteration
[SQL] Fixed 2 comment typos in SQLConf

Author: Cheng Lian <lian.cs.zju@gmail.com>

Closes #2172 from liancheng/sqlconf-typo and squashes the following commits:

115cc71 [Cheng Lian] Fixed 2 comment typos in SQLConf

(cherry picked from commit 68f75dcdfe7e8ab229b73824692c4b3d4c39946c)
Signed-off-by: Michael Armbrust <michael@databricks.com>
[SPARK-3230][SQL] Fix udfs that return structs

We need to convert the case classes into Rows.

Author: Michael Armbrust <michael@databricks.com>

Closes #2133 from marmbrus/structUdfs and squashes the following commits:

189722f [Michael Armbrust] Merge remote-tracking branch 'origin/master' into structUdfs
8e29b1c [Michael Armbrust] Use existing function
d8d0b76 [Michael Armbrust] Fix udfs that return structs

(cherry picked from commit 76e3ba4264c4a0bc2c33ae6ac862fc40bc302d83)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Revert "[maven-release-plugin] prepare for next development iteration"

This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1.
Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

This reverts commit 79e86ef3e1a3ee03a7e3b166a5c7dee11c6d60d7.
Additional CHANGES.txt
[maven-release-plugin] prepare release v1.1.0-rc1
[maven-release-plugin] prepare for next development iteration
Revert "[maven-release-plugin] prepare for next development iteration"

This reverts commit 96926c5a42c5970ed74c50db5bd9c68cacf92207.
Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

This reverts commit da4b94c86c9dd0d624b3040aa4b9449be9f60fc3.
Revert "Revert "[maven-release-plugin] prepare release v1.1.0-rc1""

This reverts commit 56070f12f455bae645cba887a74c72b12f1085f8.
Revert "Revert "[maven-release-plugin] prepare for next development iteration""

This reverts commit 71ec0140f7e121bdba3d19e8219e91a5e9d1e320.
Revert "[maven-release-plugin] prepare for next development iteration"

This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1.
Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

This reverts commit 79e86ef3e1a3ee03a7e3b166a5c7dee11c6d60d7.
Revert "[maven-release-plugin] prepare for next development iteration"

This reverts commit 78e3c036eee7113b2ed144eec5061e070b479e56.
Revert "[maven-release-plugin] prepare release v1.1.0-rc1"

This reverts commit 58b0be6a29eab817d350729710345e9f39e4c506.