Text Decoder copied the same weight as GPT2.

Graph Decoder was randomly initiated.

The LM head was also copied

```python
def clone_weight(self, config, model_name="gpt2") -> None:
    gpt2 = GPT2LMHeadModel.from_pretrained(model_name)
    self.transformer.clone_weight(config, model_name=model_name)
    self.lm_head.weight = gpt2.lm_head.weight
```
{}
transformers pytorch genkalm fill-mask autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #genkalm #fill-mask #autotrain_compatible #endpoints_compatible #region-us 

Text Decoder copied the same weight as GPT2.

Graph Decoder was randomly initiated.

The LM head was also copied


TAGS
#transformers #pytorch #genkalm #fill-mask #autotrain_compatible #endpoints_compatible #region-us 

TAGS
#transformers #pytorch #genkalm #fill-mask #autotrain_compatible #endpoints_compatible #region-us 
