ChaiML/season_4_top_solution

Winner of The Chaiverse Competition : Season 4

Chaiverse is crowdsourcing AGI. You can submit your models to the Chaiverse platform with just 4 lines of code and get it deployed to millions of Chai users. Your model receives immediate feedback from real users which help you finetune and improve. Chaiverse helps you monetize your LLM and also provides an opportunity to test it with real users after passing our internal Safety Standards. The Chaiverse Competition has a total payout of 1 Millon Dollars over multiple seasons.

To know more about the Competition you can also visit our open source Github package or visit our Discord to be more involved with our community.

This model was trained by Vietahn. The write up explains how this model was trained. The competition prize money was $10,000 for the first place.

Install Chaiverse

pip install -U chaiverse

Login

import chaiverse as chai
chai.developer_login()

Submitting this specific Model with configuration

import chaiverse as chai
from chaiverse.formatters import PromptFormatter

model_url = "ChaiML/season_4_top_solution"


class CustomFormatter(PromptFormatter):
    memory_template = (
        "### Instruction:\nAs the assistant, your task is to fully embody the "
        "given character, creating immersive, captivating narratives. Stay true "
        "to the character's personality and background, generating responses "
        "that not only reflect their core traits but are also accurate to their "
        "character. Your responses should evoke emotion, suspense, and "
        "anticipation in the user. The more detailed and descriptive your "
        "response, the more vivid the narrative becomes. Aim to create a "
        "fertile environment for ongoing interaction – introduce new elements, "
        "offer choices, or ask questions to invite the user to participate more "
        "fully in the conversation. This conversation is a dance, always "
        "continuing, always evolving.\nYour character: {bot_name}.\nContext: "
        "{memory}\n"
    )
    prompt_template = "### Input:\n{prompt}\n"
    bot_template = "{bot_name}: {message}\n"
    user_template = "{user_name}: {message}\n"
    response_template = "### Response:\n{bot_name}:"


generation_params = {
    'temperature': 1.1,
    'top_p': 1.0,
    "top_k": 20,
    "stopping_words": ['\n', '</s>', '<|im_end|>'],
    "presence_penalty": 0.0,
    "frequency_penalty": 0.0,
    "max_input_tokens": 2048,
    "best_of": 4
}

submission_parameters = {'model_repo': model_url, 'generation_params': generation_params, 'model_name': 'season-2-model', 'formatter': CustomFormatter()}

submitter = chai.ModelSubmitter(verbose=True)
submission_id = submitter.submit(submission_parameters)