Set the correct serializer in the configuration builder