boris commited on
Commit
858b8ec
β€’
1 Parent(s): 9ad5aa7

New model from https://wandb.ai/wandb/huggingtweets/runs/3ukmb9ye

Browse files
Files changed (4) hide show
  1. README.md +12 -12
  2. config.json +3 -1
  3. pytorch_model.bin +1 -1
  4. training_args.bin +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  language: en
3
- thumbnail: https://www.huggingtweets.com/lazar181/1632968892168/predictions.png
4
  tags:
5
  - huggingtweets
6
  widget:
@@ -10,7 +10,7 @@ widget:
10
  <div class="inline-flex flex-col" style="line-height: 1.5;">
11
  <div class="flex">
12
  <div
13
- style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/1429976146742026254/y93pPJs2_400x400.jpg&#39;)">
14
  </div>
15
  <div
16
  style="display:none; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;&#39;)">
@@ -20,7 +20,7 @@ widget:
20
  </div>
21
  </div>
22
  <div style="text-align: center; margin-top: 3px; font-size: 16px; font-weight: 800">πŸ€– AI BOT πŸ€–</div>
23
- <div style="text-align: center; font-size: 16px; font-weight: 800">Ari @ 😴</div>
24
  <div style="text-align: center; font-size: 14px;">@lazar181</div>
25
  </div>
26
 
@@ -38,24 +38,24 @@ To understand how the model was developed, check the [W&B report](https://wandb.
38
 
39
  ## Training data
40
 
41
- The model was trained on tweets from Ari @ 😴.
42
 
43
- | Data | Ari @ 😴 |
44
  | --- | --- |
45
- | Tweets downloaded | 3235 |
46
- | Retweets | 469 |
47
- | Short tweets | 612 |
48
- | Tweets kept | 2154 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/1h2hvk58/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @lazar181's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/2nno58g0) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/2nno58g0/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
1
  ---
2
  language: en
3
+ thumbnail: https://github.com/borisdayma/huggingtweets/blob/master/img/logo.png?raw=true
4
  tags:
5
  - huggingtweets
6
  widget:
10
  <div class="inline-flex flex-col" style="line-height: 1.5;">
11
  <div class="flex">
12
  <div
13
+ style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/1451342601483952130/-RJ3Ewqp_400x400.jpg&#39;)">
14
  </div>
15
  <div
16
  style="display:none; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;&#39;)">
20
  </div>
21
  </div>
22
  <div style="text-align: center; margin-top: 3px; font-size: 16px; font-weight: 800">πŸ€– AI BOT πŸ€–</div>
23
+ <div style="text-align: center; font-size: 16px; font-weight: 800">Ari/Sera @ πŸ›Œ</div>
24
  <div style="text-align: center; font-size: 14px;">@lazar181</div>
25
  </div>
26
 
38
 
39
  ## Training data
40
 
41
+ The model was trained on tweets from Ari/Sera @ πŸ›Œ.
42
 
43
+ | Data | Ari/Sera @ πŸ›Œ |
44
  | --- | --- |
45
+ | Tweets downloaded | 3241 |
46
+ | Retweets | 362 |
47
+ | Short tweets | 668 |
48
+ | Tweets kept | 2211 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/21d2ewj0/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @lazar181's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/3ukmb9ye) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/3ukmb9ye/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -17,7 +17,9 @@
17
  "n_inner": null,
18
  "n_layer": 12,
19
  "n_positions": 1024,
 
20
  "resid_pdrop": 0.1,
 
21
  "scale_attn_weights": true,
22
  "summary_activation": null,
23
  "summary_first_dropout": 0.1,
@@ -35,7 +37,7 @@
35
  }
36
  },
37
  "torch_dtype": "float32",
38
- "transformers_version": "4.11.1",
39
  "use_cache": true,
40
  "vocab_size": 50257
41
  }
17
  "n_inner": null,
18
  "n_layer": 12,
19
  "n_positions": 1024,
20
+ "reorder_and_upcast_attn": false,
21
  "resid_pdrop": 0.1,
22
+ "scale_attn_by_inverse_layer_idx": false,
23
  "scale_attn_weights": true,
24
  "summary_activation": null,
25
  "summary_first_dropout": 0.1,
37
  }
38
  },
39
  "torch_dtype": "float32",
40
+ "transformers_version": "4.15.0",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:90c5beefbd81680a29e2616ae299e07293ec8faf71a282a7670afb71447eef95
3
  size 510403817
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72731c0c291f184efa6d2019eb2aa142adda520723ac27ea81e012959e2e5001
3
  size 510403817
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cb2a7dbce42f1e2199675dc6c027d25d0564b03810bf687d2bfbd958b2c2eea7
3
- size 2863
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a44ad41f4d096f649862f367b784c5dcdd0ae78ff20102eb2efcc943c79a2099
3
+ size 2927