libgit2/libgit2 — pull request #1091 by carlosmn (2012-11-20 06:15:56+00:00)
Title: Indexer speedup with large objects

Introduce a way to stream the contents of a packfile, allowing the indexer to become linear. There is still no way to apply a delta while it's being streamed, so the memory pressure still exists at the end when it's time to resolve the deltas.

This simplifies the logic quite a bit but more crucially speeds up the indexing/downloading process dramatically, making the network the bottle-neck.