Don't delete plugins during upgrade #1606