Fix the slow specs

I was curious why this submission had by far the longest spec run, just turned
out to be repeated lookups from an array.  At first I just guessed at the slow
method so made some changes I didn't need to, but finally used ruby-prof to
really see where it was.  Hash lookups are so much faster :-)