[WIP] Least load scheduler: a simple version

This PR is trying to implement a least load scheduler as mentioned in #471. It is still under development but feel free to make any comment. (This PR depends on #448. I will clean the commit history later.)
If Remove took in a util.StringSet, you wouldn't have to have this O(N*M) loop.