{{#if doc.hasCustomLogo}} {{#eq doc.model "ctrl"}} {{/eq}} {{#eq doc.model "pplm"}} {{/eq}} {{else}} {{/if}}
{{#if doc.title}} {{doc.title}} {{else}} Write With Transformer {{/if}} {{#if doc.modelFamily}} {{#if doc.title}} written with {{doc.modelFamily}} {{else}} {{doc.modelFamily}} {{/if}} {{/if}}
{{#if editable}}
Select suggestion ↑ ↓ and enter
Cancel suggestion esc
{{/if}}
{{#if legacy}} Share {{else}} {{#if editable}} Save & Publish {{else}} Read-only document Duplicate & edit {{/if}} {{/if}}
{{#if doc.getHTML}} {{{ doc.getHTML }}} {{else}} {{#eq doc.model "pplm"}}

PPLM builds on top of other large transformer-based generative models (like GPT-2), where it enables finer-grained control of attributes of the generated language (e.g. gradually switching topic 🐱 or sentiment πŸ˜ƒ).

⚠️ 🐍 We had to turn off the PPLM machine as it was costly to host – try it locally using transformers, or contact us if you really need it as a hosted service. 🐍 ⚠️ {{!-- Replace this text and hit tab to trigger generations. Have fun! --}}

{{else}}

See how a modern neural network auto-completes your text πŸ€—

{{!-- In February, OpenAI unveiled a language model called GPT-2 – for Generative Pre-Trained Transformer – that generates coherent paragraphs of text one word at a time. --}} This site, built by the Hugging Face team, lets you write a whole document directly from your browser, and you can trigger the Transformer anywhere using the Tab key. It's like having a smart machine that completes your thoughts πŸ˜€

Get started by typing a custom snippet, check out the repository, or try one of the examples. Have fun!

{{/eq}} {{/if}}
Written by Transformer Β· transformer.huggingface.co πŸ¦„
{{#if editable}}
Model & decoder settings
{{#eq doc.model "pplm"}}
Bag-of-words
Discriminators
{{!--
--}}
{{/eq}}
{{#not doc.model "pplm"}}
Model size
{{/not}} {{#eq doc.model "pplm"}} pplm {{/eq}} {{#eq doc.model "distil-gpt2"}} {{/eq}} {{#eq doc.model "arxiv-nlp"}} {{/eq}} {{#eq doc.model "gpt2-large"}} {{/eq}} {{#eq doc.model "xlnet"}} {{/eq}} {{#eq doc.model "gpt"}} {{/eq}}
{{#not doc.model "pplm"}}
Top-p
Temperature
{{/not}} {{#eq doc.model "pplm"}}
Step size
KL-scale
GM-scale
Num iterations (impacts gen. time)
Gen. length (impacts gen. time)
Use sampling
{{/eq}} {{#not doc.model "pplm"}}
Max time
{{/not}}
{{/if}} {{#if editable}} {{/if}}