MAINT: add benchmark mode to runtests.py

Add benchmark running mode to runtests.py

Alternative to gh-3188 with no code duplication