I would rather handle the tiny cache case as a special case, and avoid deepening the tree unless we are getting pushed relatively hard, in the common case.  That said, I have no data to back up that claim.