Text Generation generated 

Author: chuanhhoang
Pull request: no
Labels: name: wontfix

The generated text include a lot of 










Model I am using GPT2:
Language I am using the model on English:

The problem arises when using:
`python run_generation.py --model_type=gpt2 --model_name_or_path=gpt2-large --length=500 --num_return_sequences=1 `

I am using the latest transfomer from github and build from source code and use PyTorch.
Also is there anyway to generate a different text each run?

Comments:
Hi @chuanhhoang, 

Running the same command you did actually gives me quite decent results, which are different each time I run the script (`do_sample=True` in the script which means that the models samples every time differently). 

An output I got was: 

```
F=== GENERATED SEQUENCE 1 ===

NOW REBOOTING ONCE EVERY 5 MINUTES

Before posting a rant, feel free to read the rest of this article

It's been on this strange path for a long time now: from an ostensibly well meaning project to an out of control piece of crap.

When the whole thing started back in 2012, I started down the path I'm currently on with calling it Icarus.

Being a fan of NGE, I felt like I should do something with the FEMINIST archive I'd be putting online, so I took the ideas I was getting from NGE and combined them into a short movie.

When I was finished, I needed a way to get it on to some sort of an internet scene to spread the word, so I wrote it up as a 30-minute film. That became Icarus, basically.

It's probably the easiest project I've done so far, the easiest to get some sales for, and the easiest to get friends involved with.

Thing is, with IGE and all its tropes, you can already see the script is being shown at cons and getting more and more ridiculous with each iteration. But like, two days after I made the video, I was doing 25-hour and 30-hour runs at Cineplex in Halifax that I was writing the screenplay for.

This isn't easy to do; we've all seen it, can recognize it, and just kind of go back to your normal routine for a little while. It's a marathon, but it's a marathon.

For those who've read the script, there's a lot of filler story "I don't care about you", "You'll get what's coming to you", "Listen to this I don't care if you're scared", and more exposition like that.
It's not pretty at all.

Of course, theres always the fic awards, well, that guy. The one that gives the light at the end of the tunnel.

It's fine; the fan base on here and elsewhere know this, so the fans are going to let the judges decide.

But yeah, for now, I'm playing that game. Any other reviews are written and will be under embargo. I've removed most and all of my reviews because all I've done is label each review "a movie review". That
```

Note that we now also have generation pipeline, so it shoud be easy to play around with the parameters there. Also here is a blog that might be useful to see how you can influence the generation: 
https://huggingface.co/blog/how-to-generate

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.