boris commited on
Commit
427ca9e
1 Parent(s): f1ebfd1

New model from https://wandb.ai/wandb/huggingtweets/runs/97id902s

Browse files
README.md CHANGED
@@ -43,19 +43,19 @@ The model was trained on tweets from Yann LeCun.
43
  | Data | Yann LeCun |
44
  | --- | --- |
45
  | Tweets downloaded | 3249 |
46
- | Retweets | 856 |
47
- | Short tweets | 223 |
48
- | Tweets kept | 2170 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/q4yuonfz/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @ylecun's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/2xsp6687) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/2xsp6687/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
 
43
  | Data | Yann LeCun |
44
  | --- | --- |
45
  | Tweets downloaded | 3249 |
46
+ | Retweets | 573 |
47
+ | Short tweets | 231 |
48
+ | Tweets kept | 2445 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/t83vleac/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @ylecun's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/97id902s) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/97id902s/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -37,7 +37,7 @@
37
  }
38
  },
39
  "torch_dtype": "float32",
40
- "transformers_version": "4.25.1",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
 
37
  }
38
  },
39
  "torch_dtype": "float32",
40
+ "transformers_version": "4.28.1",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 50256,
4
+ "eos_token_id": 50256,
5
+ "transformers_version": "4.28.1"
6
+ }
merges.txt CHANGED
@@ -1,4 +1,4 @@
1
- #version: 0.2 - Trained by `huggingface/tokenizers`
2
  Ġ t
3
  Ġ a
4
  h e
 
1
+ #version: 0.2
2
  Ġ t
3
  Ġ a
4
  h e
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:68c8132a09012e58ebffa8849df139f082fa849585e03ecd483fbb3147642883
3
  size 510398013
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7844ce46a9a4e600d06fa0a47cdff01c0e63e29b340678fc2cde0d89153c20fd
3
  size 510398013
tokenizer.json CHANGED
@@ -39,6 +39,7 @@
39
  "continuing_subword_prefix": "",
40
  "end_of_word_suffix": "",
41
  "fuse_unk": false,
 
42
  "vocab": {
43
  "!": 0,
44
  "\"": 1,
 
39
  "continuing_subword_prefix": "",
40
  "end_of_word_suffix": "",
41
  "fuse_unk": false,
42
+ "byte_fallback": false,
43
  "vocab": {
44
  "!": 0,
45
  "\"": 1,
tokenizer_config.json CHANGED
@@ -1,10 +1,9 @@
1
  {
2
  "add_prefix_space": false,
3
  "bos_token": "<|endoftext|>",
 
4
  "eos_token": "<|endoftext|>",
5
  "model_max_length": 1024,
6
- "name_or_path": "gpt2",
7
- "special_tokens_map_file": null,
8
  "tokenizer_class": "GPT2Tokenizer",
9
  "unk_token": "<|endoftext|>"
10
  }
 
1
  {
2
  "add_prefix_space": false,
3
  "bos_token": "<|endoftext|>",
4
+ "clean_up_tokenization_spaces": true,
5
  "eos_token": "<|endoftext|>",
6
  "model_max_length": 1024,
 
 
7
  "tokenizer_class": "GPT2Tokenizer",
8
  "unk_token": "<|endoftext|>"
9
  }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1335ed09454276c03f8f1009149e46ec3d5a0662c8819d99743e99021556ba4a
3
- size 3387
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfd93bf1a8fee516fbeae23fa38a03d395c5b471664f51a4abaf228e5cdad27e
3
+ size 3579