YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
What is it?
A GPT2 (
gpt2) language model fine-tuned on the IMDB dataset.
The GPT2 language model was fine-tuned for 1 epoch on the IMDB dataset. All comments were joined into a single text file separated by the EOS token:
import pandas as pd df = pd.read_csv("imdb-dataset.csv") imdb_str = " <|endoftext|> ".join(df['review'].tolist()) with open ('imdb.txt', 'w') as f: f.write(imdb_str)
To train the model the
run_language_modeling.py script in the
transformer library was used:
python run_language_modeling.py --train_data_file imdb.txt --output_dir gpt2-imdb --model_type gpt2 --model_name_or_path gpt2
- Downloads last month
This model can be loaded on the Inference API on-demand.