Only one initial diagonalization required when calculating spectral functions from lattice coupled bath. This actually makes it a whole load cheaper than using the self-energy. Still need to speed up the fit.
Change to inverting rather than diagonalizing. Still can speed up the calculation of the residual a lot. Work on this, + better minimizer