chriskite/anemone — Issue #49: memory leak?
Author: viotech
Created: 2012-02-22 15:28:43+00:00
State: open

Does anemone have a memory leak issue for crawling big sites? I've been experimenting with anemone to crawl a massive site and the memory for the process keeps growing for both Mongodb and the spider.rb in activity monitor.

I made a link on stack overflow a little while ago, but not sure if it is a problem with my loop or with anemone. Here is a link to the question http://stackoverflow.com/q/9395026/1225765

If this is an issue with my code and not anemone, I apologize for posting the issue here.