travis-ci/travis-core — pull request #177 by svenfuchs (2013-01-24 05:36:40+00:00)
Title: [wip] archive logs

Putting this up for discussion.

https://api-staging.travis-ci.org/jobs/385667/log.txt

This gets a basic log archiver started. It basically does the following:

* triggers an event `log:aggregated`
* adds an addon `Archive`
* listens to `log:aggregated` and queues archive tasks
* the task fetches the given log from the http api and stores them to an s3 bucket: https://api-staging.travis-ci.org/jobs/385667/log.txt

Required improvements:

* make it possible to run log update tasks locally on `travis-logs` but log archive tasks remotely on `travis-tasks`
* keep tabs of archiving (store the log url on the job?) and redirect from api to s3 for now (later make the client aware of the same)
* adjust the client to use the log url

Things to consider:

* when exactly should the archiver run?
* what should the url look like? do we need versioning?
* how to deal with deansi