Don't attempt duplicate outputs

This ends up causing weird errors like those seen in #11346

Closes #11346