minimum of 90 or that longish equation
some print statements to let you know where you are
try not clustering the grids with data in an area
trial 30 cells to start, not 90

trying to make multiple runs possible, but still fills up RAM
not paying attention, forgot to checkout current work
refactoring stuff.

extract data model work to data.model.R

trying to use plyr

I am lame
runtime debugging

using plyr to split data frame, create models tested.
more runtime debugging.

getting there.  called main routine from orbit, seems to work. now to
run the whole schebang
running outer loop

need to preserve group splitting thing.  can handle 300+, but RAM
creeps up too high for my machines with 8G
use plyr's built in parallel...works so far, we'll see if it finishes

apparently automatically copies objects??
getting there.  integrated plyr parallel stuff into getallthegrids.R

testing, not yet running right.
stop removed, put inside try handler

the stop proved its point, seems like I am asking for 67 runs.  Now
move the stop inside the try loop

I think what happened before was that the loop dropped down such that
there was only one cell per group, as I kept failing during the
group.loop (probably during couchdb save??)
bug in call to plyr

needed .(runs.index) not runs.index

I think
pass year to inner function
run it by uncommenting runme()!
limit to just 10 cell predictions, and dump json to screen

retarded waste of pixels, but gotta make sure stuff is getting saved
Seems to be working so far, but not sure why it wasn't working before.
print just the doc ids prior to bulksave
fixed!  stupid bug, squashed

found the bug that prevented the runs from actually *doing* anything
useful.  I forgot to index the list of hpms grid cells, by the picked
index, so that the plyr runs were looking into the full list, not the
indexed list, and were repeating past runs rather than finishing the
todo list.

bleh
put the clustering code back in

without the clustering code, the imputation of grid cells is really
slow, because it is dependent on the size of the model...more grid
cells in the model, the longer the prediction of the hpms.grid cells.

The assignment of hpms cells to freeway cell clusters is by no means
the best, but it is good enough for now....getting a result that is
close is better than waiting forever for a result that is only a tiny
amount "better"
uncomment runme()

or nothing will happen!