LoRA: Low-Rank Adaptation of Large Language Models
Paper • 2106.09685 • Published • 61
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
What is SamSum Bot?
This is a model fine-tuned on the SamSum dataset. However, instead of training the system to summarize conversations, the model is trained to predict a conversation given a summary. The prompt needs to be in the following form
A partial summary of the conversation is:
{summary}
With the dialogue being:
{dialogue}
where {summary} is a text as in
John went out to buy groceries. He meets Jane on the way and they talk about the weather.
and the {dialogue} needs to be structured with speaking lines preceded by the speaking character
John: Oh hi Jane.
Jane: Nice to see you?
John: The weather looks nice today
Jane: [PREDICTION]
The system is based on the GPTJ-6B by EleutherAI, quantized by Hivemind. It has been fine-tuned according to the LoRa method. A simple back-end is available in this repo, where the model is served using Torchserve. A terminal-like front-end interface is available here. This interface is the one used in my website http://fractalego.io.
- Downloads last month
- 5