SPY-287 updated streaming iterable

Pulls in the current state of https://github.com/apache/incubator-spark/pull/421, allowing n-partition jobs instead of only one partition at a time.