boris commited on
Commit
d7387d1
1 Parent(s): 585d6bc

New model from https://wandb.ai/wandb/huggingtweets/runs/1ya7k60i

Browse files
Files changed (4) hide show
  1. README.md +8 -8
  2. config.json +3 -1
  3. pytorch_model.bin +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  language: en
3
- thumbnail: https://www.huggingtweets.com/elonmusk/1635259353788/predictions.png
4
  tags:
5
  - huggingtweets
6
  widget:
@@ -42,20 +42,20 @@ The model was trained on tweets from Elon Musk.
42
 
43
  | Data | Elon Musk |
44
  | --- | --- |
45
- | Tweets downloaded | 250 |
46
- | Retweets | 9 |
47
- | Short tweets | 76 |
48
- | Tweets kept | 165 |
49
 
50
- [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/10agakyt/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @elonmusk's tweets.
55
 
56
- Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/151rcczo) for full transparency and reproducibility.
57
 
58
- At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/151rcczo/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
 
1
  ---
2
  language: en
3
+ thumbnail: https://github.com/borisdayma/huggingtweets/blob/master/img/logo.png?raw=true
4
  tags:
5
  - huggingtweets
6
  widget:
 
42
 
43
  | Data | Elon Musk |
44
  | --- | --- |
45
+ | Tweets downloaded | 400 |
46
+ | Retweets | 23 |
47
+ | Short tweets | 122 |
48
+ | Tweets kept | 255 |
49
 
50
+ [Explore the data](https://wandb.ai/wandb/huggingtweets/runs/2zny28qr/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
51
 
52
  ## Training procedure
53
 
54
  The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @elonmusk's tweets.
55
 
56
+ Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/1ya7k60i) for full transparency and reproducibility.
57
 
58
+ At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/1ya7k60i/artifacts) is logged and versioned.
59
 
60
  ## How to use
61
 
config.json CHANGED
@@ -17,7 +17,9 @@
17
  "n_inner": null,
18
  "n_layer": 12,
19
  "n_positions": 1024,
 
20
  "resid_pdrop": 0.1,
 
21
  "scale_attn_weights": true,
22
  "summary_activation": null,
23
  "summary_first_dropout": 0.1,
@@ -35,7 +37,7 @@
35
  }
36
  },
37
  "torch_dtype": "float32",
38
- "transformers_version": "4.11.3",
39
  "use_cache": true,
40
  "vocab_size": 50257
41
  }
 
17
  "n_inner": null,
18
  "n_layer": 12,
19
  "n_positions": 1024,
20
+ "reorder_and_upcast_attn": false,
21
  "resid_pdrop": 0.1,
22
+ "scale_attn_by_inverse_layer_idx": false,
23
  "scale_attn_weights": true,
24
  "summary_activation": null,
25
  "summary_first_dropout": 0.1,
 
37
  }
38
  },
39
  "torch_dtype": "float32",
40
+ "transformers_version": "4.12.3",
41
  "use_cache": true,
42
  "vocab_size": 50257
43
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a027be5a22c272e98de45ea2e4faae4b2b180b0a3275940dc83259377cfb608f
3
  size 510403817
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a732b1b017ab8a8451d39011b739cbdde515ed21a91a2df7b933e345544ed0d
3
  size 510403817
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c7f25c1e146d7f5a772ff3ae832270eafb5002fd6d3f76aa9a1a94b1fa2c4f4
3
  size 2863
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c22d8b54c9eeefe91ecf1472a6d572db622491e705a917c6a338df7ea39b51ac
3
  size 2863