Prevent a Matrioska runner from being started twice


This really ought to be a state machine