File size: 1,678 Bytes
6ab4c99
 
 
 
 
 
5ebdf36
6ab4c99
 
 
 
 
 
 
 
 
 
 
5ebdf36
 
 
 
6ab4c99
 
 
 
 
5ebdf36
6ab4c99
 
 
9f33d7f
 
 
 
6ab4c99
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
---
library_name: peft
base_model: MBZUAI/LaMini-Flan-T5-783M
---

# Model Card for Model ID
Finetuned version of `MBZUAI/LaMini-Flan-T5-783M` for MCQA answer. Produced in the context of EPFL course **CS-552 : Modern Natural Language Processing**



## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->



- **Developed by:** MNLPredators
- **Model type:** Seq2Seq
- **Language(s) (NLP):** English
- **Finetuned from model :** MBZUAI/LaMini-Flan-T5-783M

### Model Sources [optional]

<!-- Provide the basic links for the model. -->

- **Repository:** (MNLPredators repo)[https://github.com/CS-552/project-m3-2024-mnlpredators/tree/main]
- **Paper [optional]:** [More Information Needed]


### Pipeline

![Pipelin](full_pipeline.png) 


## Training Details

### Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[More Information Needed]

### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

#### Preprocessing [optional]

[More Information Needed]


#### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

#### Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

[More Information Needed]