common; don't use move pointers

This didn't make sense since pointer are even bigger than the move
structures! Let's revert the commit.