NuGet/NuGetGallery — pull request #538 by half-ogre (2012-06-28 18:40:41+00:00)
Title: cached tab completion package ids

This is the first in a series of changing using a distributed cache to speed things up.

For now, this uses Windows Azure Caching (via DataCache, not the memcache gateway), but it uses a memcache-friendly abstraction so we can also add a memcache impl (and switch to the Azure memcache gateway) down the road easily.

Before this change, calls to the package IDs API were in the range of .2s to 4s, with the mean being .4s and the dispersion being very high. With this change, once cached, the range is .02s to .08s, with the mean .04s, and the dispersion being much tighter around the mean.