dawoz commited on
Commit
5b5e9f4
1 Parent(s): 0aa02fa

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +7 -45
README.md CHANGED
@@ -9,50 +9,12 @@ model-index:
9
  results: []
10
  ---
11
 
12
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
- should probably proofread and complete it, then remove this comment. -->
14
 
15
- # idefics-frozenlake
 
 
16
 
17
- This model is a fine-tuned version of [HuggingFaceM4/idefics-9b-instruct](https://huggingface.co/HuggingFaceM4/idefics-9b-instruct) on an unknown dataset.
18
-
19
- ## Model description
20
-
21
- More information needed
22
-
23
- ## Intended uses & limitations
24
-
25
- More information needed
26
-
27
- ## Training and evaluation data
28
-
29
- More information needed
30
-
31
- ## Training procedure
32
-
33
- ### Training hyperparameters
34
-
35
- The following hyperparameters were used during training:
36
- - learning_rate: 0.0001
37
- - train_batch_size: 4
38
- - eval_batch_size: 4
39
- - seed: 42
40
- - gradient_accumulation_steps: 8
41
- - total_train_batch_size: 32
42
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
- - lr_scheduler_type: linear
44
- - lr_scheduler_warmup_steps: 50
45
- - num_epochs: 2
46
- - mixed_precision_training: Native AMP
47
-
48
- ### Training results
49
-
50
-
51
-
52
- ### Framework versions
53
-
54
- - PEFT 0.12.0
55
- - Transformers 4.44.2
56
- - Pytorch 2.4.0+cu121
57
- - Datasets 2.16.1
58
- - Tokenizers 0.19.1
 
9
  results: []
10
  ---
11
 
12
+ ## Model performance on frozenlake prompts dataset
 
13
 
14
+ Vanilla model performance:
15
+ - Exact match: 0.00%
16
+ - F1: 14.27%
17
 
18
+ Fine-tuned model performance:
19
+ - Exact match: 0.00%
20
+ - F1: 28.93%