[TO_STAGE] fix bz 1156361. Race condition between destroy-app and configure.

Fix for https://bugzilla.redhat.com/show_bug.cgi?id=1156361