Document wq_pool on-demand foreman issues
wq worker does not timeout when there are available results
Merge pull request #351 from btovar/wq_no_timeout_when_results

Worker does not timeout from being idle when it has task results waiting to be retrieved by master.
Make the options for debug file and output file consistent with rest of CCTools.
Fix AllPairs tests to use the new option for output file.
Clean up WQ stats:
1. add new information on tasks (cancelled), workers (joined, idle), reported
resources (bandwidth, memory, etc) to WQ stats.
2. reorganize and group related fields in stats structure.
3. reorganize the format of the log so related fields are grouped together.
4. remove the printing of deprecated fields in the log.
Report total_tasks_cancelled, total_workers_joined, and workers_idle to the
catalog.
Added perl-dev to README.debian
Limit the size of retrieved stdout of a task to 1 GB. Note we receive all the
bytes transmitted by the worker but only return upto 1GB to the application. We
throw away the bytes beyond 1GB.
Remove the worker on failures when retrieving the results (stdout) of a task.
Describe the recommended practice when accessing the output (stdout) buffer of a
task.
Hit nd.edu webserver instead of cse.nd.edu.
If memory allocation for stdout buffer fails, we
drop the stdout read from the link and return an empty buffer.
If link_soak failed, it will corrupt the order of
the data we expect to read next on the link. This will cause failure and
disconnection. So remove the code for checking failure of link_soak.
Use absolute path for sourcefile when using symbolic links. Otherwise, the
symlink will refer to a path relative to the directory of the destination.
Convert user specified working directory to an absolute path.
Comments wq python example
perl example as python example
Use --debug-file like other tools.
Fix memory leaks reported by Valgrind.