Remove intermediate data more aggressively to save memory.