evanp/activitypump — Issue #20: Scalability level 0
Author: evanp
Created: 2012-01-09 03:21:24+00:00
State: open

I'm interested in seeing this project make scale a priority.

So, here's my first scalability goal: consider a network of 100,000 users. There is a Pareto distribution of number of followers per user, with an 80-20 rule distribution (good enough) and an expected value of the Dunbar number, 150. See http://en.wikipedia.org/wiki/Pareto_distribution for help on this.

The scalability goal is to handle 10 new activities per second (aps) with a maximum delivery time of 100 seconds.

In the future, we can vary the numbers by orders of magnitude (100 aps, 10^6 users, 10s for delivery) to reach higher goals.