Added baroque book-keeping to avoid calculating pointless Hessians