Fix deleting plugins a bit more