Combined the adjoint with the state for the assembly. Seems to be converging.