Make ConvOp propagate any available shape information to instantiated gradient ops