boris commited on
Commit
b1ec85c
1 Parent(s): 6002174

New model from https://wandb.ai/wandb/huggingtweets/runs/2jfeof85

Browse files
README.md CHANGED
@@ -43,19 +43,19 @@ The model was trained on tweets from Barack Obama.
43
  | Data | Barack Obama |
44
  | --- | --- |
45
  | Tweets downloaded | 3250 |
46
- | Retweets | 321 |
47
- | Short tweets | 19 |
48
- | Tweets kept | 2910 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/3hkhteaz/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @barackobama's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/3kbv2k23) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/3kbv2k23/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
43
  | Data | Barack Obama |
44
  | --- | --- |
45
  | Tweets downloaded | 3250 |
46
+ | Retweets | 319 |
47
+ | Short tweets | 17 |
48
+ | Tweets kept | 2914 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/tjijp9lf/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @barackobama's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/2jfeof85) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/2jfeof85/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -37,7 +37,7 @@
37
  }
38
  },
39
  "torch_dtype": "float32",
40
- "transformers_version": "4.25.1",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
37
  }
38
  },
39
  "torch_dtype": "float32",
40
+ "transformers_version": "4.28.1",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 50256,
4
+ "eos_token_id": 50256,
5
+ "transformers_version": "4.28.1"
6
+ }
merges.txt CHANGED
@@ -1,4 +1,4 @@
1
- #version: 0.2 - Trained by `huggingface/tokenizers`
2
  Ġ t
3
  Ġ a
4
  h e
1
+ #version: 0.2
2
  Ġ t
3
  Ġ a
4
  h e
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f56b4cef0375a03ff83b6ce51fbfaf7f7123a0e066f9b1dd08a7156f4b0edc1
3
  size 510398013
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e481b4899732be7df63646cab01ade19d265274516db1817e5ab3b1676d0d15f
3
  size 510398013
tokenizer.json CHANGED
@@ -39,6 +39,7 @@
39
  "continuing_subword_prefix": "",
40
  "end_of_word_suffix": "",
41
  "fuse_unk": false,
 
42
  "vocab": {
43
  "!": 0,
44
  "\"": 1,
39
  "continuing_subword_prefix": "",
40
  "end_of_word_suffix": "",
41
  "fuse_unk": false,
42
+ "byte_fallback": false,
43
  "vocab": {
44
  "!": 0,
45
  "\"": 1,
tokenizer_config.json CHANGED
@@ -1,10 +1,9 @@
1
  {
2
  "add_prefix_space": false,
3
  "bos_token": "<|endoftext|>",
 
4
  "eos_token": "<|endoftext|>",
5
  "model_max_length": 1024,
6
- "name_or_path": "gpt2",
7
- "special_tokens_map_file": null,
8
  "tokenizer_class": "GPT2Tokenizer",
9
  "unk_token": "<|endoftext|>"
10
  }
1
  {
2
  "add_prefix_space": false,
3
  "bos_token": "<|endoftext|>",
4
+ "clean_up_tokenization_spaces": true,
5
  "eos_token": "<|endoftext|>",
6
  "model_max_length": 1024,
 
 
7
  "tokenizer_class": "GPT2Tokenizer",
8
  "unk_token": "<|endoftext|>"
9
  }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:056839648911b30e6f4f64b754ba8d506a0eb75f22903a3aaa17a03b3eb0c93e
3
- size 3451
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4adfb66678c24a20a4adc9f602686f48945a6ac027f687d61b9d5c2be484ed1
3
+ size 3579