Run each test in a new bot thread

This provides more isolation and makes it a lot easier to debug
problems, as all captured logging pertains to one test and one test
only.

Closes #124