apiengine/seoserver — pull request #10 by richard-flosi (2013-08-31 00:47:01+00:00)
Title: add minResponses and minContentLength; updated config options;

I've added some more config options:
First, I renamed the previous verbose to debug which defaults to false. (should be false in production)
Second, I added a new verbose option which defaults to true and just logs more info about each url that is processed.
minResponses is new and is used as part of the completed processing check for phantom. Users will want to configure this for their app.
minContentLength is also new and used just like minResponses, but checks the Content-Length.
I found sometimes the seoserver was responding before there were enough request/responses and/or the content-length was longer than the default index.html content. Adding these checks made the results a bit more reliable.

I updated the debugging related log messages to use console.error which according to the nodejs docs should print to stderr instead of stdout, but that doesn't seem to be the case. :(
http://nodejs.org/api/stdio.html#stdio_console_error_data
Which is why it is also important that debug is false in production, otherwise a bunch of request/response data will be returned to the search bot.

Let me know if you have questions. The README should get updated (sorry I didn't do that for you).