is openai-gpt based on gpt3 model?
#2
by
sjaini
- opened
is openai-gpt based on gpt3 model?
no, it predates it
I think this is GPT-1?
yes @anentropic
Hi there, I was curious how to to make our own model from this model? So that I can train my own model, etc. Or this is not possible as the source is not provided? I've checked the files but no clue on how to train it and make it our own.
@julien-c do u have guidance?
The source for this model can be found in the HF transformers library: https://github.com/huggingface/transformers/blob/main/src/transformers/models/openai/modeling_openai.py
And pre-trained weights are here: https://huggingface.co/openai-gpt/blob/main/pytorch_model.bin