apache/spark — pull request #128 by tgravescs (2014-03-12 16:15:38+00:00)
Title: [SPARK-1198] Allow pipes tasks to run in different sub-directories

This works as is on Linux/Mac/etc but doesn't cover working on Windows. In here I use ln -sf for symlinks. Putting this up for comments on that. Do we want to create perhaps some classes for doing shell commands - Linux vs Windows. Is there some other way we want to do this? I assume we are still supporting jdk1.6?

Also should I update the Java API for pipes to allow this parameter?