mxcl/homebrew — pull request #11642 by mikemcquaid (2012-04-14 08:06:34+00:00)
Title: Unleash the BrewBot.

I've been building up to this for a while but thought I'd keep it quiet until it was mostly done.

BrewBot currently is a script that operates a bit like brew-pull and runs a series of tests on either a formula or pull request (commits are to follow later). It will output to the console whether each test passes or fails (now you can see why I cared about exit codes), optionally an HTML page with the status of the current and past tests and optionally comment on the issue with the list of failures or state the success.

Once we get some hardware (this is in progress) and I get feedback on this then I'll have it running all the time on 10.7 and 10.6 and posting to pull requests automatically (and it could check individual commits too). I plan to also have this by the method for building bottles on request too.

Still TODO in this particular script are handling commits, commenting with links to the HTML page so you can see what went wrong and a basic interface to allow you to tell it to run certain pull requests again or upload a previously generated bottle.

You can see it's been in action here:
https://github.com/mxcl/homebrew/pull/11640

A basic test command would be `brew test-bot 11640 --html`

Let me know your thoughts; hopefully this is something which can save us all a lot of effort.