harishnair04 commited on
Commit
6bba74a
1 Parent(s): 3955949

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -8
README.md CHANGED
@@ -1,17 +1,21 @@
1
- library_name: transformers
 
 
 
 
 
 
 
 
2
  tags:
3
  - trl
4
  - sft
5
  - quantization
6
  - 4bit
7
- - lora
8
- license: apache-2.0
9
- base_model: google/gemma-2-2b
10
- datasets:
11
- - medicaltranscriptions
12
- pipeline_tag: text-generation
13
  ---
14
 
 
15
  # Model Card for Medical Transcription Model (Gemma-MedTr)
16
 
17
  This model is a fine-tuned variant of `Gemma-2-2b`, optimized for medical transcription tasks with efficient 4-bit quantization and Low-Rank Adaptation (LoRA). It handles transcription processing, keyword extraction, and medical specialty classification.
@@ -49,4 +53,4 @@ bnb_config = BitsAndBytesConfig(
49
  )
50
 
51
  tokenizer = AutoTokenizer.from_pretrained(model_id, token=access_token_read)
52
- model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map='auto', token=access_token_read)
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - harishnair04/mtsamples
5
+ language:
6
+ - en
7
+ base_model:
8
+ - google/gemma-2-2b
9
+ pipeline_tag: text-generation
10
  tags:
11
  - trl
12
  - sft
13
  - quantization
14
  - 4bit
15
+ - LoRA
 
 
 
 
 
16
  ---
17
 
18
+
19
  # Model Card for Medical Transcription Model (Gemma-MedTr)
20
 
21
  This model is a fine-tuned variant of `Gemma-2-2b`, optimized for medical transcription tasks with efficient 4-bit quantization and Low-Rank Adaptation (LoRA). It handles transcription processing, keyword extraction, and medical specialty classification.
 
53
  )
54
 
55
  tokenizer = AutoTokenizer.from_pretrained(model_id, token=access_token_read)
56
+ model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map='auto', token=access_token_read)