Retry deactivateAppForDuration to workaround #556

Fix: #556