prompter: Can you please explain how Open Assistant works? I am specifically looking for a discussion of how the model is trained and what the model architecture is. Second, I would appreciate a description of the motives behind why Open Assistant was created.

assistant: Sure, Open assistant is an open source chat-based assistant created following instruct-gpt paper training methodology. It aims to provide an assistant capable of understanding tasks, interacting with third party systems an retrieving information dynamically from internet.

The model used for the creation of Open assistant is a large language model consisting of an Encoder, Embeddings and a Decoder following the transformer architecture. 

The model is trained following the next phases: 

1. Collect demonstration data: During this phase human demonstrations are collected. The demonstrations are collected in a data structure called conversation tree, the conversation tree contains prompts, assistant answer and the community provided score for each of the tree nodes. Additional data is collected from from sites like Quora, StackOverflow and appropriate subreddits.

2. Fine tune a base model:   A base model then is fine tuned using the collected dataset

3. Train a reward model: During this phase a prompt and several data answers are sampled, the answers are ranked from best to worst. The Reward model is trained using the ranked answers.

4. Optimize a policy against the reward model: The output of the reward model is used as a scalar reward to fine-tune the model generated in step 2.

Open Assistant was created to give everyone access to a great chat based large language model. It was created in the same spirit as stable-diffusion. Open Assistant goal is to improve the world by providing an open unifying platform that all other system can use easily interface with humans.

Hope you find this answer helpful, let me know if you have any additional question!

prompter: Is it possible for me to help in any way?

assistant: Open Assistant is based on the InstructGPT paper from OpenAI. It is trained on a collection of curated human responses.

The motives behind Open Assistant are providing an open source alternative to ChatGPT. The stated goal is to provide an open model that can be run on an average users’ system.

prompter: Is there anywhere I can go to learn more, such as a GitHub project page?

assistant: Yes, you can go to their GitHub page here: https://github.com/LAION-AI/Open-Assistant
There is also a Discord server that you can join: https://ykilcher.com/open-assistant-discord

assistant: Yes. Here is a link to the Official GitHub repository for the project: https://github.com/LAION-AI/Open-Assistant

assistant: Yes - Here's the Github project page: https://github.com/LAION-AI/Open-Assistant

assistant: Sure, as of the time of my most recent training data, Open Assistant, was not yet complete. A lot of this will be speculation and won't include the most recent updates and information. 

Open Assistant is based on a large language model (LLM). The model itself will likely be based on : GPT-J, CodeGen, FlanT5, or GPT-JT. It will likely be composed of several ancillary models as well as a large body of logic to allow Open Assistant to interface with various automation interfaces.

The Open Assistant project was started as part of LAION, a non-profit, with a mission to bring truly open artificial intelligence and machine learning to the public. In addition to making source, datasets, and the model open, Open Assistant is also being sized to run on consumer grade hardware rather than the massive hardware required for other similar GPT models.

assistant: As a text generating AI, I'm prone to factual mistake, so before asking me I'd strongly recommend you check open assistant web site and GitHub.
Open Assistant is an open source text generating model. It is often portrayed as "open source chatGPT", because at that time OpenAI became more and more restrictive, and people wanted better alternatives.

prompter: Where can I find the website and github?

prompter: As I was asking, I'm looking for technical details about your training. Do you use transformer model? how much compute time does it take on a typical GPU to train open assistant? Please just tell me what you know, I'll remember to double check, but now I need a quick, roughly correct answer.