File size: 3,569 Bytes
271b9d1
 
1986e4f
271b9d1
 
 
 
 
 
bc6f16a
271b9d1
19efd6d
 
 
 
271b9d1
 
 
 
 
 
 
 
 
 
 
 
6d5e2ee
271b9d1
 
 
 
 
bc6f16a
 
 
 
 
 
 
 
 
 
73439ac
bc6f16a
 
 
73439ac
bc6f16a
 
 
73439ac
bc6f16a
 
 
73439ac
bc6f16a
 
 
 
73439ac
271b9d1
 
 
2c421f6
271b9d1
73439ac
bc6f16a
73439ac
271b9d1
 
 
bc6f16a
271b9d1
 
 
19efd6d
 
 
 
 
 
271b9d1
bc6f16a
271b9d1
 
 
 
 
 
 
 
 
bc6f16a
6d5e2ee
271b9d1
 
 
 
1c4aa40
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
---
language: en
thumbnail: https://www.huggingtweets.com/julien_c/1605217958996/predictions.png
tags:
- huggingtweets
widget:
- text: "My dream is"
---


<div>
  <div style="width: 132px; height:132px; border-radius: 50%; background-size: cover; background-image: url('https://pbs.twimg.com/profile_images/1108502565925326850/zPsBf2BI_400x400.png')">
  </div>
  <div style="margin-top: 8px; font-size: 19px; font-weight: 800">Julien Chaumond 🤖 AI Bot </div>
  <div style="font-size: 15px; color: #657786">@julien_c bot</div>
</div>

I was made with [huggingtweets](https://github.com/borisdayma/huggingtweets).

Create your own bot based on your favorite user with [the demo](https://colab.research.google.com/github/borisdayma/huggingtweets/blob/master/huggingtweets-demo.ipynb)!

## How does it work?

The model uses the following pipeline.

![pipeline](https://github.com/borisdayma/huggingtweets/blob/master/img/pipeline.png?raw=true)

To understand how the model was developed, check the [W&B report](https://app.wandb.ai/wandb/huggingtweets/reports/HuggingTweets-Train-a-model-to-generate-tweets--VmlldzoxMTY5MjI).

## Training data

The model was trained on [@julien_c's tweets](https://twitter.com/julien_c).

<table style='border-width:0'>
<thead style='border-width:0'>
<tr style='border-width:0 0 1px 0; border-color: #CBD5E0'>
<th style='border-width:0'>Data</th>
<th style='border-width:0'>Quantity</th>
</tr>
</thead>
<tbody style='border-width:0'>
<tr style='border-width:0 0 1px 0; border-color: #E2E8F0'>
<td style='border-width:0'>Tweets downloaded</td>
<td style='border-width:0'>3211</td>
</tr>
<tr style='border-width:0 0 1px 0; border-color: #E2E8F0'>
<td style='border-width:0'>Retweets</td>
<td style='border-width:0'>915</td>
</tr>
<tr style='border-width:0 0 1px 0; border-color: #E2E8F0'>
<td style='border-width:0'>Short tweets</td>
<td style='border-width:0'>371</td>
</tr>
<tr style='border-width:0'>
<td style='border-width:0'>Tweets kept</td>
<td style='border-width:0'>1925</td>
</tr>
</tbody>
</table>

[Explore the data](https://wandb.ai/wandb/huggingtweets/runs/2puhbhcj/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.

## Training procedure

The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on @julien_c's tweets.

Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/wandb/huggingtweets/runs/245ieai8) for full transparency and reproducibility.

At the end of training, [the final model](https://wandb.ai/wandb/huggingtweets/runs/245ieai8/artifacts) is logged and versioned.

## Intended uses & limitations

### How to use

You can use this model directly with a pipeline for text generation:

```python
from transformers import pipeline
generator = pipeline('text-generation',
                     model='huggingtweets/julien_c')
generator("My dream is", num_return_sequences=5)
```

### Limitations and bias

The model suffers from [the same limitations and bias as GPT-2](https://huggingface.co/gpt2#limitations-and-bias).

In addition, the data present in the user's tweets further affects the text generated by the model.

## About

*Built by Boris Dayma*


[![Follow](https://img.shields.io/twitter/follow/borisdayma?style=social)](https://twitter.com/intent/follow?screen_name=borisdayma)

For more details, visit the project repository.

[![GitHub stars](https://img.shields.io/github/stars/borisdayma/huggingtweets?style=social)](https://github.com/borisdayma/huggingtweets)