boris commited on
Commit
5c6059e
1 Parent(s): cdf1457

New model from https://wandb.ai/wandb/huggingtweets/runs/no8iew6j

Browse files
README.md CHANGED
@@ -1,17 +1,27 @@
1
  ---
2
  language: en
3
- thumbnail: https://www.huggingtweets.com/domonic_m/1614065648307/predictions.png
4
  tags:
5
  - huggingtweets
6
  widget:
7
  - text: "My dream is"
8
  ---
9
 
10
- <div>
11
- <div style="width: 132px; height:132px; border-radius: 50%; background-size: cover; background-image: url('https://pbs.twimg.com/profile_images/1146161910448054273/b1HpVczo_400x400.png')">
12
- </div>
13
- <div style="margin-top: 8px; font-size: 19px; font-weight: 800">Domonic 🤖 AI Bot </div>
14
- <div style="font-size: 15px">@domonic_m bot</div>
 
 
 
 
 
 
 
 
 
 
15
  </div>
16
 
17
  I was made with [huggingtweets](https://github.com/borisdayma/huggingtweets).
@@ -24,28 +34,28 @@ The model uses the following pipeline.
24
 
25
  ![pipeline](https://github.com/borisdayma/huggingtweets/blob/master/img/pipeline.png?raw=true)
26
 
27
- To understand how the model was developed, check the [W&B report](https://app.wandb.ai/wandb/huggingtweets/reports/HuggingTweets-Train-a-model-to-generate-tweets--VmlldzoxMTY5MjI).
28
 
29
  ## Training data
30
 
31
- The model was trained on [@domonic_m's tweets](https://twitter.com/domonic_m).
32
 
33
- | Data | Quantity |
34
  | --- | --- |
35
- | Tweets downloaded | 387 |
36
- | Retweets | 61 |
37
- | Short tweets | 50 |
38
- | Tweets kept | 276 |
39
 
40
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/110suyx0/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
41
 
42
  ## Training procedure
43
 
44
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @domonic_m's tweets.
45
 
46
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/2do1thkt) for full transparency and reproducibility.
47
 
48
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/2do1thkt/artifacts) is logged and versioned.
49
 
50
  ## How to use
51
 
1
  ---
2
  language: en
3
+ thumbnail: https://github.com/borisdayma/huggingtweets/blob/master/img/logo.png?raw=true
4
  tags:
5
  - huggingtweets
6
  widget:
7
  - text: "My dream is"
8
  ---
9
 
10
+ <div class="inline-flex flex-col" style="line-height: 1.5;">
11
+ <div class="flex">
12
+ <div
13
+ style="display:inherit; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;https://pbs.twimg.com/profile_images/1146161910448054273/b1HpVczo_400x400.png&#39;)">
14
+ </div>
15
+ <div
16
+ style="display:none; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;&#39;)">
17
+ </div>
18
+ <div
19
+ style="display:none; margin-left: 4px; margin-right: 4px; width: 92px; height:92px; border-radius: 50%; background-size: cover; background-image: url(&#39;&#39;)">
20
+ </div>
21
+ </div>
22
+ <div style="text-align: center; margin-top: 3px; font-size: 16px; font-weight: 800">🤖 AI BOT 🤖</div>
23
+ <div style="text-align: center; font-size: 16px; font-weight: 800">Domonic</div>
24
+ <div style="text-align: center; font-size: 14px;">@domonic_m</div>
25
  </div>
26
 
27
  I was made with [huggingtweets](https://github.com/borisdayma/huggingtweets).
34
 
35
  ![pipeline](https://github.com/borisdayma/huggingtweets/blob/master/img/pipeline.png?raw=true)
36
 
37
+ To understand how the model was developed, check the [W&B report](https://wandb.ai/wandb/huggingtweets/reports/HuggingTweets-Train-a-Model-to-Generate-Tweets--VmlldzoxMTY5MjI).
38
 
39
  ## Training data
40
 
41
+ The model was trained on tweets from Domonic.
42
 
43
+ | Data | Domonic |
44
  | --- | --- |
45
+ | Tweets downloaded | 502 |
46
+ | Retweets | 70 |
47
+ | Short tweets | 69 |
48
+ | Tweets kept | 363 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/1q7f1cu6/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @domonic_m's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/no8iew6j) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/no8iew6j/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -19,6 +19,7 @@
19
  "n_layer": 12,
20
  "n_positions": 1024,
21
  "resid_pdrop": 0.1,
 
22
  "summary_activation": null,
23
  "summary_first_dropout": 0.1,
24
  "summary_proj_to_labels": true,
@@ -34,7 +35,8 @@
34
  "top_p": 0.95
35
  }
36
  },
37
- "transformers_version": "4.3.2",
 
38
  "use_cache": true,
39
  "vocab_size": 50257
40
  }
19
  "n_layer": 12,
20
  "n_positions": 1024,
21
  "resid_pdrop": 0.1,
22
+ "scale_attn_weights": true,
23
  "summary_activation": null,
24
  "summary_first_dropout": 0.1,
25
  "summary_proj_to_labels": true,
35
  "top_p": 0.95
36
  }
37
  },
38
+ "torch_dtype": "float32",
39
+ "transformers_version": "4.9.2",
40
  "use_cache": true,
41
  "vocab_size": 50257
42
  }
flax_model.msgpack DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f04e33f971947729f5a006ea507e398febf3379174de5baa27072869f43bbaa4
3
- size 497764120
 
 
 
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a7d39f48019e5a48896edb7178fea7edee0265f89bbe1e2cca8bc6d6b97446cf
3
- size 510406552
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01db95eb274ff767f39cb7f27eddaf8ea462fc583d258f53b6b4d72be6a68a5b
3
+ size 510403817
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
tokenizer_config.json CHANGED
@@ -1 +1 @@
1
- {"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "name_or_path": "gpt2"}
1
+ {"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "gpt2", "tokenizer_class": "GPT2Tokenizer"}
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5520a40545bba4cbfb4dee4c540bf7c356e4947744642a4b85f917fe2820ec53
3
- size 2159
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3d08f8673c208618741d79fcf3feeb2ef2b3fd2e71b24244eb4998e1c5402a4
3
+ size 2671