papuGaPT2 / allegro_reviews /create_config_allegro.py

Copying papuGaPT2 Flax model repo

3b456c2 almost 3 years ago

No virus

197 Bytes

	from transformers import GPT2Config

	model_dir = "." # ${MODEL_DIR}

	config = GPT2Config.from_pretrained("gpt2", resid_pdrop=0.0, embd_pdrop=0.0, attn_pdrop=0.0)
	config.save_pretrained(model_dir)