Fix abort benchmark test

In some cases a benchmark may complete before we have a chance to abort
it. Just log these cases and continue.