Remove S3funnel from mapreduce code
Merge branch 'master' into remove_s3funnel_from_mapreduce
Merge branch 'master' into remove_s3funnel_from_mapreduce
Add an "overflow" ProcessIncoming autoscale group

Set up an autoscale group that will kick in if the backlog gets even longer than
the trigger for the normal ProcessIncoming scale-up threshold. This should help
in the case where our spot price bid is too low for extended periods of time.
Use hvm or pv images as needed. Update AMIs.

Turns out m1.xlarge instances can't use hvm images, so we re-deploy with pv
images (and update the webserver image while we're at it).
Send stdout and stderr to a separate log file

Helpful for debugging.
Add ami-creation config files.
Merge pull request #26 from jonasfj/master

/etc/boto.cfg, fixes to analysis-worker-stack.yaml, cowboy trick necessity reduction :)
Pass through AWS credentials if available.
Check the error name instead of number.

Also use the lib function instead of repeating the code.
Handle rename across devices.
Merge branch 'master' into remove_s3funnel_from_mapreduce
Choose your own reduce separators, add setup_reduce function

Make the field and record separators into fields so that MR jobs can specify
their own without having to post-process.  This lets us output CSV instead of
tab-separated output.

A `setup_reduce(context)` function is also added to allow jobs to do any
required pre-reduce setup.
Removed a superfluous "not None" check.
Bail (nicely) if we don't match any input files
Add an error message if we fail to fetch remotes.
Fix regex bug.
Merge pull request #27 from vitillo/master

Fix regexp bug. GCC has problems parsing regexes with brackets.
Update the 'apt-get' docs
Ensure that we preserve large int values.

Previously we'd lose precision on values larger than max int.  The update to
the rapidjson patch fixes that. Also added a test to exercise that case.