rays2pix
/

gpt2-tamil

Model card Files Files and versions Metrics Training metrics Community

gpt2-tamil / create_config.py

rays2pix's picture

Setup training for gpt2 on oscar-ta

c423737 almost 3 years ago

raw history blame contribute delete

No virus

208 Bytes

	from transformers import GPT2Config

	model_dir = "./gpt2-tamil" # ${MODEL_DIR}

	config = GPT2Config.from_pretrained("gpt2", resid_pdrop=0.0, embd_pdrop=0.0, attn_pdrop=0.0)
	config.save_pretrained(model_dir)