BLD: Send Travis-CI results to ScatterCI
State: closed

Our CI situation could be better. Travis is great but doesn't do windows or 32 bit, the SPARC 
buildbot provided by @yarikoptic lives in another location and the windows jenkins box isn't 
publicly viewable. That means :red_circle:  builds have been going unnoticed, sometimes for months 
until it's time to do  a release and we inevitably go  spelunking through commits from 2 months 
ago to find the problem.

Each platform features some uncorrelated failures so grabbing as much as we can will improve
our overall testing coverage.

To address these types of problems, I've started working on a side-project called ScatterCI.
You can check out the beta version here: [![screenshot - 01092014 - 04 44 52 pm](https://f.cloud.github.com/assets/1820866/1878516/a2dd1c78-793c-11e3-9aac-40f4d23c4c32.png)](http://scatterci.github.io/ScatterCI-Pandas/).

This PR should start getting travis jobs on the status page and the windows jenkins box already 
submits results from it's nightlies.

If you hit problems with the status page, please open an issue up on the [ScatterCI-Pandas](http://scatterci.github.io/ScatterCI-Pandas/issues/new) repo, not here. 
It's not a Pandas thing just a service useful to the project.

@yarikoptic, @neirbowj  if you're interested, I can send you an API key and have you
and your favorite platform join the CI fun. It should just take a few minutes to setup and 
a full-blown CI server is not even required, a nightly cron job would work just as well.


Labels:

Comments:
sounds interesting and useful.  I can't promise immediate action but if you provide a brief howto and the key I might well enable reporting back from that sparc box

+1 !

@yarikoptic , you've got mail.

@y-p looks real nice..

minor issue...i have to click left of the 'builds | platforms' (and not on the arrow) to open...?

Just fixed it a few minutes ago. Try now?

beautiful!

now for the feature request!!

you are printing the output on a filed build, maybe have someway to show the config as well (like on a good build)...maybe another icon?
of course their are skipped tests to show too....

re config, Look again. 

I'll keep the other suggestion in mind.

@y-p: This looks very promising. I would love to try setting up a buildbot, but I won't have time for that until at least mid-February. Would you like to send me an API key now, and have me sit on it a bit, or shall I send up a flare when I've got some time?

a dedicated CI box isn't required (but would be great), even a nightly cron (if you don't want to tie up a cpu)
would still be an improvement.

Ping me when you'd like to give it a try and I'll send you an email with everything.

The error output is kind of awesome :+1: 

Awesome! Can I set it to email me or something like that?

I plan to have it mail notifications to a mailing list so anyone could opt in.

ping @yarikoptic,  SPARC builds started failing again sometime in the last week, It
would really help if you send the buildbot job reports to the ScatterCI server.
I guarantee it'll make things easier for everyone. If there are any technical issues, 
I'm glad to help.

probably just time/personal difficulties... I will try to set it up
within a week... if you could provide a patch against
http://github.com/nipy/nibotmi that would "rush it up"

On Sat, 18 Jan 2014, y-p wrote:

>    ping [1]@yarikoptic, SPARC builds started failing again sometime in the
>    last week, It
>    would really help if you send the buildbot job reports to the ScatterCI
>    server.
>    I guarantee it'll make things easier for everyone. If there are any
>    technical issues,
>    I'm glad to help.
> 
>    —
>    Reply to this email directly or [2]view it on GitHub.
> 
> References
> 
>    Visible links
> 1. https://github.com/yarikoptic
> 2. https://github.com/pydata/pandas/pull/5893#issuecomment-32695559

## 

Yaroslav O. Halchenko, Ph.D.
http://neuro.debian.net http://www.pymvpa.org http://www.fail2ban.org
Senior Research Associate,     Psychological and Brain Sciences Dept.
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834                       Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik

Thanks @yarikoptic. Blind config changes are low-probability-of-intercept
and setting up a buildbot seems like a painful task.

I've rearranged things a bit, and the script we use for travis is
now a self-contained example of what needs to run, with comments.
Just fill in the envars.

https://github.com/pydata/pandas/blob/master/ci/after_script.sh

Hope that helps a little.

Has Scatter-CI been moved? or is it no more?

its no more... @y-p has shall we say, removed himself entirely from the pandas loop. he felt his opinions were not being hear I think.

i'm sorry to hear that ... learned a lot from him

Sorry to hear this also. I hope he'll consider returning in the future...