jorge-henao commited on
Commit
d3fd23a
1 Parent(s): f662a9f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -3,18 +3,23 @@ license: apache-2.0
3
  ---
4
  <h1>
5
  <a alt="Ask2Democracy project" href="https://github.com/jorge-henao/ask2democracy">Ask2Democracy project</a>
 
6
  </h1>
7
  <hr>
8
 
 
 
 
9
  ## What's baizemocracy-lora-7B-cfqa-conv model?
10
 
11
  This model is an open-source chat model fine-tuned with [LoRA](https://github.com/microsoft/LoRA) inspired by [Baize project](https://github.com/project-baize/baize-chatbot/tree/main/). It was trained with the Baize datasets and the ask2democracy-cfqa-salud-pension dataset, wich contains almost 4k instructions to answers questions based on a context relevant to citizen concerns and public debate in spanish.
12
- Two major experiments models was performed during the Hackathon Somos NLP 2023:
 
13
  - A conversational style focused model
14
- - A contex focused style model.
15
 
16
- This model is focused in a more conversational way of asking questions. See Pre-proccessing dataset section.
17
- There is other model variation more focused on augmented retrieval based on context [Baizemocracy-contextfocused](https://github.com/project-baize/baize-chatbot/tree/main/).
18
 
19
  Testing is a work in progress, we decide to share both model variations with community in order to invovle more people experimenting what it works better and find other possible use cases.
20
 
 
3
  ---
4
  <h1>
5
  <a alt="Ask2Democracy project" href="https://github.com/jorge-henao/ask2democracy">Ask2Democracy project</a>
6
+ This model was trained during the Hackathon Somos NLP 2023 and we are working to integrate in the AskDemocracy space demo.[AskDemocracy space demo](https://huggingface.co/spaces/jorge-henao/ask2democracycol)
7
  </h1>
8
  <hr>
9
 
10
+ ## About Ask2Democracy project
11
+ This model was trained during the 2023 Somos NLP Hackathon and it's part of the Ask2Democracy project. We encountered performance constraints due to the model's size, which resulted in limited hardware capacity (approximately 70 seconds per inference using a GPU). As a result, we are currently working on optimizing ways to integrate the model into the [AskDemocracy space demo](https://huggingface.co/spaces/jorge-henao/ask2democracycol)
12
+
13
  ## What's baizemocracy-lora-7B-cfqa-conv model?
14
 
15
  This model is an open-source chat model fine-tuned with [LoRA](https://github.com/microsoft/LoRA) inspired by [Baize project](https://github.com/project-baize/baize-chatbot/tree/main/). It was trained with the Baize datasets and the ask2democracy-cfqa-salud-pension dataset, wich contains almost 4k instructions to answers questions based on a context relevant to citizen concerns and public debate in spanish.
16
+
17
+ Two model variations was trained during the Hackathon Somos NLP 2023:
18
  - A conversational style focused model
19
+ - A generative context focused model
20
 
21
+ This model variation is focused in a more conversational way of asking questions. See Pre-proccessing dataset section.
22
+ There is other model variation more focused on source based augmented retrieval generation [Baizemocracy-RAGfocused](https://huggingface.co/hackathon-somos-nlp-2023/baizemocracy-lora-7B-cfqa).
23
 
24
  Testing is a work in progress, we decide to share both model variations with community in order to invovle more people experimenting what it works better and find other possible use cases.
25