[SPARK-3431] [WIP] Parallelize test execution

This is currently a work in progress to experiment with various options for parallelizing tests.
@JoshRosen Do you know what this `<<=` syntax means? I couldn't find mention of it in the docs.