Revert "Remove unnecessary app push"

This reverts commit 671c62f46ed37c2d7371d46a09311ebaaeed4b9c.

Test has been too flaky on CI. Ain't nobody got time for that