Fixed a memory leak where Memoizer wasn't removing empty buffers from
the memoTable.