twitter/summingbird — pull request #537 by johnynek (2014-08-13 02:47:33+00:00)
Title: Initial add of the generic optimizer code

Before digging into this code, look at the Rules implemented at the bottom of DagOptimizer.

There are several TODOS here:

1) After I split the code into separate files, I started hitting a scala 2.9 compiler bug, that I don't hit in 2.10. I'll try to work around, or possibly hope that Twitter finally gets on 2.9 before we need this.

2) Tests tests tests. I played around at the repl, but clearly we need super hardcore tests for any optimization framework.

3) Actually call this code from an existing platform.