Cyrile commited on
Commit
3141ee4
1 Parent(s): df1a58e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -22,7 +22,7 @@ The training for the distilled model (student model) is designed to be the close
22
 
23
  The final loss function is a combination of these three losses functions. We use the following ponderation:
24
 
25
- *Loss = 0.5 DistilLoss + 0.2 MLMLoss + 0.3 CosineLoss*
26
 
27
  Dataset
28
  -------
 
22
 
23
  The final loss function is a combination of these three losses functions. We use the following ponderation:
24
 
25
+ $$Loss = 0.5 \times DistilLoss + 0.2 \times MLMLoss + 0.3 \times CosineLoss$$
26
 
27
  Dataset
28
  -------