boris commited on
Commit
3ab7882
1 Parent(s): b7d3b02

New model from https://wandb.ai/wandb/huggingtweets/runs/2g6ndbxy

Browse files
Files changed (5) hide show
  1. README.md +6 -6
  2. config.json +2 -1
  3. pytorch_model.bin +1 -1
  4. tokenizer.json +0 -0
  5. training_args.bin +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  language: en
3
- thumbnail: https://www.huggingtweets.com/elonmusk/1620769488795/predictions.png
4
  tags:
5
  - huggingtweets
6
  widget:
@@ -44,18 +44,18 @@ The model was trained on tweets from Elon Musk.
44
  | --- | --- |
45
  | Tweets downloaded | 3249 |
46
  | Retweets | 210 |
47
- | Short tweets | 800 |
48
- | Tweets kept | 2239 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/1dfjqq2l/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @elonmusk's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/1p1bqvt3) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/1p1bqvt3/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
 
1
  ---
2
  language: en
3
+ thumbnail: https://github.com/borisdayma/huggingtweets/blob/master/img/logo.png?raw=true
4
  tags:
5
  - huggingtweets
6
  widget:
 
44
  | --- | --- |
45
  | Tweets downloaded | 3249 |
46
  | Retweets | 210 |
47
+ | Short tweets | 801 |
48
+ | Tweets kept | 2238 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/3ja3jqgu/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @elonmusk's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/2g6ndbxy) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/2g6ndbxy/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -19,6 +19,7 @@
19
  "n_layer": 12,
20
  "n_positions": 1024,
21
  "resid_pdrop": 0.1,
 
22
  "summary_activation": null,
23
  "summary_first_dropout": 0.1,
24
  "summary_proj_to_labels": true,
@@ -34,7 +35,7 @@
34
  "top_p": 0.95
35
  }
36
  },
37
- "transformers_version": "4.5.1",
38
  "use_cache": true,
39
  "vocab_size": 50257
40
  }
 
19
  "n_layer": 12,
20
  "n_positions": 1024,
21
  "resid_pdrop": 0.1,
22
+ "scale_attn_weights": true,
23
  "summary_activation": null,
24
  "summary_first_dropout": 0.1,
25
  "summary_proj_to_labels": true,
 
35
  "top_p": 0.95
36
  }
37
  },
38
+ "transformers_version": "4.6.0",
39
  "use_cache": true,
40
  "vocab_size": 50257
41
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a8954eb206a5353c2ac20e1139eacbfa7693479594e6adba5e8f4e6cd489390
3
  size 510408315
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e58c94195d8b374c831f5398022eed8a688776c320c3a003b848a6bc8fcfd54a
3
  size 510408315
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1f1c17236e3d04af62206e7b2afdcf30a1d66cce1ef91b808400ac5e1a78a9cc
3
- size 2351
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:875b2aba5650c95f8640b99a9a4b4eb2163e837e476c3923f38117b254237ad9
3
+ size 2415