Finally got the arduino side of things up to par.  We can now send 24+ frames to the board and it can keep up.