Before revision:   This work establishes an important first step towards optimization guided design of deep models.
After revision:  We show that deep OptEq outperforms previous implicit models even with fewer parameters. This work establishes an important first step towards optimization guided design of deep models.