Separate TimeVaryingTransforms in Stream, so frames may be given to non-TimeVaryingTransforms in parallel