boris commited on
Commit
735105c
1 Parent(s): 279ce7d

New model from https://wandb.ai/wandb/huggingtweets/runs/ury2pnlm

Browse files
README.md CHANGED
@@ -42,20 +42,20 @@ The model was trained on tweets from Elon Musk.
42
 
43
  | Data | Elon Musk |
44
  | --- | --- |
45
- | Tweets downloaded | 3250 |
46
- | Retweets | 181 |
47
- | Short tweets | 824 |
48
- | Tweets kept | 2245 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/2mc26k46/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @elonmusk's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/98thwfk2) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/98thwfk2/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
 
42
 
43
  | Data | Elon Musk |
44
  | --- | --- |
45
+ | Tweets downloaded | 822 |
46
+ | Retweets | 36 |
47
+ | Short tweets | 233 |
48
+ | Tweets kept | 553 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/1ui0qfcf/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @elonmusk's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/ury2pnlm) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/ury2pnlm/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -19,7 +19,6 @@
19
  "n_layer": 12,
20
  "n_positions": 1024,
21
  "resid_pdrop": 0.1,
22
- "scale_attn_weights": true,
23
  "summary_activation": null,
24
  "summary_first_dropout": 0.1,
25
  "summary_proj_to_labels": true,
@@ -35,8 +34,7 @@
35
  "top_p": 0.95
36
  }
37
  },
38
- "torch_dtype": "float32",
39
- "transformers_version": "4.9.2",
40
  "use_cache": true,
41
  "vocab_size": 50257
42
  }
 
19
  "n_layer": 12,
20
  "n_positions": 1024,
21
  "resid_pdrop": 0.1,
 
22
  "summary_activation": null,
23
  "summary_first_dropout": 0.1,
24
  "summary_proj_to_labels": true,
 
34
  "top_p": 0.95
35
  }
36
  },
37
+ "transformers_version": "4.4.2",
 
38
  "use_cache": true,
39
  "vocab_size": 50257
40
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3b60878d891d16541da6b7c9b213b00aa6af039444c2aeccba7f9ed071de8e67
3
- size 510403817
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41e4de6cc2c024cc9f4df6de8e7fb648eb84925119246f01904e9249d7d313d6
3
+ size 510408315
tokenizer.json DELETED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json CHANGED
@@ -1 +1 @@
1
- {"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2", "tokenizer_class": "GPT2Tokenizer"}
 
1
+ {"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2"}
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:041cd0e25df60c6980d36213bd642fa87c566309195580347c36ba7184ab78b4
3
- size 2671
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5652b4d6dd492355c891fd48cd26682c970da92b35c73d7e04f10cdcffa738d3
3
+ size 2287