Convert some of benchmark to assertions

-  This is the only way to make sure I know what the hell is broken when
   it breaks