Use fewer threads for plugin-based checks.

Fixes #5748