Do not crash when source plugins conflict

Fixes #3015 and #3180.