Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Text Decoder copied the same weight as GPT2.

Graph Decoder was randomly initiated.

The LM head was also copied

def clone_weight(self, config, model_name="gpt2") -> None:
    gpt2 = GPT2LMHeadModel.from_pretrained(model_name)
    self.transformer.clone_weight(config, model_name=model_name)
    self.lm_head.weight = gpt2.lm_head.weight
Downloads last month
7