Pclanglais commited on
Commit
428b114
1 Parent(s): 0f941d1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -1,3 +1,19 @@
1
  **Chatrag-Deberta** is a small lightweight LLM to predict whether a question should retrieve additional information with RAG or not.
2
 
3
- Chatrag-Deberta is based on Deberta-v3, a 304M encoder-decoder. Its initial version was fine-tuned on 20,000 examples of questions annotated by Mistral 7B.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  **Chatrag-Deberta** is a small lightweight LLM to predict whether a question should retrieve additional information with RAG or not.
2
 
3
+ Chatrag-Deberta is based on Deberta-v3, a 304M encoder-decoder. Its initial version was fine-tuned on 20,000 examples of questions annotated by Mistral 7B.
4
+
5
+ ## Use
6
+
7
+ The inference_chatrag.py file provides a typical example of inference with Chatrag-Deberta.
8
+
9
+ For every submitted text, Chatrag-Deberta will output a range of probabilities to require RAG or not.
10
+
11
+ This makes it possible to adjust a threshold of activation depending on whether more or less RAG is desirable in the system.
12
+
13
+ | Query | Prob | Result |
14
+ |----------------------------------------------------------|:---------:|--------:|
15
+ | Comment puis-je renouveler un passeport ? | 0.988455 | RAG |
16
+ | Combien font deux et deux ? | 0.041475 | No-RAG |
17
+ | Écris un début de lettre de recommandation pour la Dinum | 0.103086 | No-RAG |
18
+
19
+