Fixed a scoping issue with memory.

Memory was only catching points for memory from the _last_
sub-network processed.