Provide a better error message for duplicate plans

[Finishes #62601096]