fix the increased output issue

Think @singhala 's issue of larger intermediate outputs is due to this issue.

The tests which we added last time we touched this code should protect us here. Simple enough change.