Forbid pub/priv where it has no effect

Closes #5495
auto merge of #8423 : alexcrichton/rust/less-priv-again, r=bstrie

Closes #5495