Don't try to kill the same extra instance more than once

[# 54246826]