---
language:
- en
---

BigBirdPegasus weights before finetuning as per [this](https://github.com/google-research/bigbird) repo.
Converted to PyTorch as per [this](https://github.com/huggingface/transformers/blob/v4.25.1/src/transformers/models/bigbird_pegasus/convert_bigbird_pegasus_tf_to_pytorch.py) script.