Removing memoization.

It wasn't actually contributing to a speedup.