Merge branch 'main' of https://huggingface.co/buruzaemon/distilbert-base-uncased-finetuned-clinc

README.md

@@ -34,7 +34,7 @@ It achieves the following results on the evaluation set:
 
 ## Model description
 
-More information needed
+This is an initial example of knowledge-distillation where the student loss is all cross-entropy loss \\(L_{CE}\\) of the ground-truth labels and none of the distillation loss \\(L_{KD}\\).
 
 ## Intended uses & limitations
 
@@ -42,13 +42,17 @@ More information needed
 
 ## Training and evaluation data
 
-More information needed
+The training and evaluation data come straight from the `train` and `validation` splits in the clinc_oos dataset, respectively; and tokenized using the `distilbert-base-uncased` tokenization.
 
 ## Training procedure
 
+Please see page 224 in Chapter 8: Making Transformers Efficient in Production, Natural Language Processing with Transformers, May 2022.
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
+- alpha: 1.0
+- temperature: 2.0
 - learning_rate: 2e-05
 - train_batch_size: 48
 - eval_batch_size: 48