Only stop app if it was previously created during push

[finishes #61348064]