memcached/memcached — pull request #53 by jackdoe (2014-01-08 11:40:58+00:00)
Title: Stampede/Thundering Herd protection

Simply fake a NOT FOUND on one get request when the item is about to expire.

The time it takes to recover from some stampedes can be dramatically high, depending on the time it takes to calculate the key's value.

I just thought it will be very simple to fake a miss to one of the get requests, it will take its time calculating the value
and update it, without the other guys noticing anything.

This pull request is very limited, as it keeps the state locally, but still having (nodes*fake misses) is manageable.

P.S. I am almost certain that there is better way to implement this, so think of this pull request more as of 'request for comment' on the idea to include somekind of stampede protection in memcached