heliosbrahma commited on
Commit
23436ad
1 Parent(s): 4b7eed5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -3
README.md CHANGED
@@ -1,10 +1,19 @@
1
  ---
 
2
  base_model: ybelkada/falcon-7b-sharded-bf16
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
  - name: falcon-7b-sharded-bf16-finetuned-mental-health-conversational
7
  results: []
 
 
 
 
 
 
 
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -16,18 +25,20 @@ This model is a fine-tuned version of [ybelkada/falcon-7b-sharded-bf16](https://
16
 
17
  ## Model description
18
 
19
- More information needed
20
 
21
  ## Intended uses & limitations
22
 
23
- More information needed
24
 
25
  ## Training and evaluation data
26
 
27
- More information needed
28
 
29
  ## Training procedure
30
 
 
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
 
1
  ---
2
+
3
  base_model: ybelkada/falcon-7b-sharded-bf16
4
  tags:
5
  - generated_from_trainer
6
  model-index:
7
  - name: falcon-7b-sharded-bf16-finetuned-mental-health-conversational
8
  results: []
9
+ license: mit
10
+ datasets:
11
+ - heliosbrahma/mental_health_chatbot_dataset
12
+ language:
13
+ - en
14
+ metrics:
15
+ - rouge
16
+ pipeline_tag: conversational
17
  ---
18
 
19
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
25
 
26
  ## Model description
27
 
28
+ This model is fine-tuned on custom mental health conversational dataset. The rationale behind this is to answer mental health related queries that can be factually verified without responding gibberish words.
29
 
30
  ## Intended uses & limitations
31
 
32
+ The model was trained on the dataset which may contain sensitive information related to mental health. It is important to note that while mental health chatbots built using this model can be helpful, they are not a replacement for professional mental health care.
33
 
34
  ## Training and evaluation data
35
 
36
+ This model was trained on custom [heliosbrahma/mental_health_chatbot_dataset](https://huggingface.co/datasets/heliosbrahma/mental_health_chatbot_dataset) dataset which 172 rows of conversational pair of questions and answers.
37
 
38
  ## Training procedure
39
 
40
+ This model was trained using QLoRA technique to fine-tune on a custom dataset on free-tier GPU available in Google Colab.
41
+
42
  ### Training hyperparameters
43
 
44
  The following hyperparameters were used during training: