Issue 'app configure' if we're not on master already