Practically speaking, you're right. The cache will only contain the locn actually referenced, but since a lot of our code references all xblocks in a course, then the cache entry will contain all of those.