LRUCache optimisation

This improves LRUCache performance pretty substantially (particularly for the multithreaded case) while keeping the same basic algorithm as it had before. I'm afraid the bulk of the work is in a single commit, because the rather wandering path I took to get to this point didn't make sense as individual commits. I have however added a lot of documentation to the private members which hopefully does a pretty decent job of explaining what's going on - so it probably makes more sense just to read the final result rather than look at the diffs.
I guess this may be a different pull request as well. I'm not sure how the MemoryAccumulator affects the suggestion on the Cost size. But It seems you have already something in mind.