Keep track of unknown fields so that things still serialize.