Handle the reinstallall case with confirmation. Fixes #3548