Adding more logging to ingestion.

BUG=skia:
TBR=stephana

Review URL: https://codereview.chromium.org/734483003
logserver: Add dirWatcher to delete app logs above threshold and put data in influxDB.

dir watcher runs every 10 seconds (configurable). It does the following:
* Checks to see if an app's logs exceeds the specified log limit threshold. If it does then it deletes the oldest files till the app's space usage is below app_log_threshold - app_log_threshold_buffer.
* New encountered logs are reported to InfluxDB.

State of the logserver is also saved. This helps make sure that if the logserver is restarted then it does not report old logs as new ones to InfluxDB.

Also includes the following bug fixes:
* Moved the HTML writing logic out of the Readdir loop.
* Created separate sections so kept it out of the loop.
* skiamonitoring -> skiamonitor.com

BUG=skia:

Review URL: https://codereview.chromium.org/723263002
BugChomper utility - rewrite in Go

BUG=skia:
R=jcgregorio@google.com

Author: borenet@google.com

Review URL: https://codereview.chromium.org/274693002

git-svn-id: http://skia.googlecode.com/svn/trunk@14715 2bbb7eff-a529-9590-31e7-b0007b416f81
BugChomper: Get the oauth_client_secret from GS

BUG=skia:
NOTRY=true
(SkipBuildbotRuns)

R=jcgregorio@google.com

Author: borenet@google.com

Review URL: https://codereview.chromium.org/288593003

git-svn-id: http://skia.googlecode.com/svn/trunk@14718 2bbb7eff-a529-9590-31e7-b0007b416f81
Add warning about GOPATH to bug_chomper/run_server.sh

BUG=skia:2551
R=scroggo@google.com

Author: borenet@google.com

Review URL: https://codereview.chromium.org/285763003

git-svn-id: http://skia.googlecode.com/svn/trunk@14732 2bbb7eff-a529-9590-31e7-b0007b416f81
Fix goauth path

BUG=skia:2551
R=scroggo@google.com

Author: borenet@google.com

Review URL: https://codereview.chromium.org/288763002

git-svn-id: http://skia.googlecode.com/svn/trunk@14737 2bbb7eff-a529-9590-31e7-b0007b416f81
Run goimports through 'go' code in bug_chomper.

$ cd ~/golib
$ go get code.google.com/p/go.tools/cmd/goimports
$ cd ~/skia/tools/bug_chomper/
$ ~/golib/bin/goimports -w src/

BUG=None
TEST=None
R=borenet@google.com

Review URL: https://codereview.chromium.org/624813002
bug_chomper: Use parenthesized declaration style for const and vars.

It seems cleaner that way and nicer to read, also avoids repeating
'const' and 'var' everytime you have to add more items.

BUG=None
TEST=./run_server.sh
R=borenet@google.com

Review URL: https://codereview.chromium.org/645803003
bug_chomper: Make server's port configurable.

Make 'port' a flag so you can change it from the command line, making the
server more flexible and allowing us to change in which port it listen
to requests.

$ ./run_server.sh --port :8002

BUG=None
TEST=see above
R=borenet@google.com

Review URL: https://codereview.chromium.org/649663003
bug_chomper: Consolidate public flag in a single place.

BUG=None
TEST=./run_server.sh --help and ./run_server.sh -public
R=borenet@google.com

Review URL: https://codereview.chromium.org/649303003
bug_chomper: Cleanup template initialization.

Use the same tricks used by webtry and perf. Code seems more robust and
easier to check for errors this way.

BUG=None
TEST=./run_server.sh, then navigate to 127.0.0.1:8000 and
127.0.0.1:8000/res
R=borenet@google.com

Review URL: https://codereview.chromium.org/661613004
Move bug_chomper into subdirectory
Fix non-* refs in gitinfo

BUG=skia:
TBR=stephana

Review URL: https://codereview.chromium.org/720113005