For now, we're trying to maintain Python 2.6 compatibility in the core of PySpark (because Python 2.6 is still the default in a lot of environments), so I don't think we can use argparse here.