Don't delete plugins during upgrade

This should fix issue #1606