Add negation for infinities, and neg