hpcc-systems/HPCC-Platform — Issue #871: Memory pool exhausted (in Disk Read G22 E23)
Author: rengolin
Created: 2011-10-31 14:39:11+00:00
State: open

I'm getting memory errors when running the IMDB example. After fixing (or not) bug #860 and running the count snippet on the manual:

IMPORT IMDB;
#option ('hthorMemoryLimit', 5000);
IMDB.KevinBaconNumberSets.doCounts;

And getting the error "Memory pool exhausted (in Disk Read G22 E23)"

Snippets of the log:

RoxieMemMgr: Setting memory limit to 947912704 bytes (904 pages)
RoxieMemMgr: 928 Pages successfully allocated for the pool - memsize=973078528 base=0x7f2e42a00000 alignment=1048576 bitmapSize=29

(...)

,FileAccess,HThor,READ,hthor,(null),temp::imdb::actorsinmovies,W20111031-135037,graph2
DISKWRITE: using temporary filename /var/lib/HPCCSystems/myeclagent/temp/W20111031-135037.~spill__scope__D3__W20111031-135037
Reading file /var/lib/HPCCSystems/myeclagent/temp/W20111031-135037.~spill__scope__C3__W20111031-135037
Reading file /var/lib/HPCCSystems/hpcc-data/eclagent/temp/imdb/actorsinmovies._1_of_1
RoxieMemMgr: Memory pool (928 pages) exhausted
1451: /home/rengolin/workspace/hpcc/src/ecl/eclagent/eclgraph.cpp(1755) : EclAgent::executeGraph : Memory pool exhausted (in Disk Read G22 E23)
Disk write incomplete, deleting physical file: /var/lib/HPCCSystems/myeclagent/temp/W20111031-135037.~spill__scope__D3__W20111031-135037
ERROR: 1451: Memory pool exhausted (in Disk Read G22 E23) (in item 3)
Releasing run lock