Are you envisioning including the PySpark dependencies in the Spark assembly jar?  I think that could work, since we need to build that jar anyways when running under YARN.

I'm not sure how easy it will be to modify the Maven or SBT builds to include those files.