theblackcat102's picture
Update README.md
253de58
|
raw
history blame
No virus
1.37 kB
metadata
license: mit
language:
  - en
  - zh
  - de
  - fr
  - ja
  - ko
  - es
widget:
  - text: Hi assistant How can I help you
  - text: user: Python  C++ 哪个更好学?哪个更强大?我该怎么选择?
  - text: >-
      user: Good morning\n assistant: Good morning! How can I assist you
      today?
pipeline_tag: text2text-generation
tags:
  - text-generation-inference

Generate title for conversation

How to use

model_name = "theblackcat102/alpaca-title-generator-mt0-large"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
question = 'Hi\nHow can I help you?'
encodes = tokenizer(question, return_tensors='pt')
outputs = model.generate(encodes.input_ids, 
    max_length=512,
    do_sample=True,
    repetition_penalty=1.2,
    top_k=50,
    num_return_sequences=1,
    early_stopping=True
)
for i, beam_output in enumerate(outputs):
    print('-----')
    print("{}".format(tokenizer.decode(beam_output, skip_special_tokens=True)))
# > Help requested.

Generate title data

data was generated using response pair from yahma/alpaca-cleaned and use openai turbo model for title.

""
user: {}
assistant: {}
""

Generate a very short title within 5 words of the conversation above, title must be as relevant as possible. Title language must be same as the context

TITLE: