metadata

license: mit
language:
  - en
  - zh
  - de
  - fr
  - ja
  - ko
widget:
  - text: Hi assistant How can I help you
  - text: user&#58; Python 和 C++ 哪个更好学？哪个更强大？我该怎么选择？
  - text: >-
      user&#58; Good morning\n assistant&#58; Good morning! How can I assist you
      today?
pipeline_tag: text2text-generation
tags:
  - text-generation-inference

Generate title for conversation

How to use

model_name = "theblackcat102/alpaca-title-generator-mt0-large"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
question = 'Hi\nHow can I help you?'
encodes = tokenizer(question, return_tensors='pt')
outputs = model.generate(encodes.input_ids, 
    max_length=512,
    do_sample=True,
    repetition_penalty=1.2,
    top_k=50,
    num_return_sequences=1,
    early_stopping=True
)
for i, beam_output in enumerate(outputs):
    print('-----')
    print("{}".format(tokenizer.decode(beam_output, skip_special_tokens=True)))
# > Help requested.

Generate title data

data was generated using response pair from yahma/alpaca-cleaned and use openai turbo model for title.

""
user: {}
assistant: {}
""

Generate a very short title within 5 words of the conversation above, title must be as relevant as possible. Title language must be same as the context

TITLE: