Remove internal uses of the `NoCopy` marker

r? @aturon / @alexcrichton
This may actually want to keep one private field to ensure that it cannot be constructed outside of this module.