Silent outputter

This allows me to call a runner and only get the return data back.

PS. I accidentally got the commit from PR #4072 into this PR as well, ohwell.