benchmark: properly handle missing plugins.

Signed-off-by: Evan Nemerson <evan@coeus-group.com>