Return early if we can't evalf the summand.

Fix at the source.