Memoize access to sequence dictionaries and reference to avoid repeated hits to disk