mapbox/tilelive-mapnik — Issue #27: skipblank memory usage and main loop blocking
Author: springmeyer
Created: 2012-03-03 17:47:15+00:00
State: open

I'm starting to be more convinced that the skipblank branch uses memory too aggressively. Partially related, it also blocks the main loop, leading to the eio threadpool being underutilized.

E.g. I am unable to detect any memory leaks at the v8/node/mapnik level (e.g. or deeper problems). Even if v8 garbage collection is forced during skipping (using `while (!mapnik.gc()) {}` it is still very easy to run out of memory when many tiles are being skipped.

This is a ticket to discuss possible ways to work around this.

Ideas:

1) move parts of code to c++ module

2) more agressive use of process.nextTick