Only monitor RUNNING instances

[Finishes #53030105]