mozilla/socorro — pull request #1394 by shuhaowu (2013-08-09 03:41:28+00:00)
Title: [WIP: Do not merge] Detecting suspicious/explosive crashes

Still work in progress. But this should be the idea for the cron job. Feedback will be nice.

I would like to add the mware and interface stuff in separate PRs to limit the amount of code reviews.

Right now the model is fairly "dumb". Smarter models could be developed but most of them are based on the existing math (and code framework) and should be fairly easy to add in.

Todos:

- [ ] Testing? What is the policy on this?
- [ ] DB migration: created a new table. Haven't done this yet
- [ ] Further model creation (ARIMA model next. Don't have parameters yet).
- [ ] Remove some debugging code: I left some in, I'll take them out as I get closer to a more final version.

Note about code review: There is a blob of math somewhere in this PR (not sure what the final structure will look like). There are some comments describing them and links to the original implementations/papers. As (if) I develop more complicated models, more math functions (blobs) will be added into the mix. While for some of these stuff I don't have theoretical verifications that I did this correctly, I did experimentally verify them to the best of my abilities (results are in docstrings/comments). If someone wants to mathematically prove it and tell me I'm wrong, please do so :).

Do **not** merge this just yet as it is still WIP.