Don't attempt duplicate outputs

This ends up causing weird errors like those seen in #11346

Closes #11346
auto merge of #11347 : alexcrichton/rust/issue-11346, r=brson

This ends up causing weird errors like those seen in #11346

Closes #11346