Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ We fine-tuned DistilBERT on triplets consisting of:
|
|
20 |
- a post from a different, randomly selected user (the "negative example")
|
21 |
|
22 |
|
23 |
-
To compute the loss, we use [CLS] encoding of the anchor, positive example and negative example from the last layer of the DistilBERT encoder. We optimize for \\(max(||f(a) - f(n)|| -
|
24 |
|
25 |
where:
|
26 |
- \\( f(a)\\) is the [CLS] encoding of the anchor;
|
|
|
20 |
- a post from a different, randomly selected user (the "negative example")
|
21 |
|
22 |
|
23 |
+
To compute the loss, we use [CLS] encoding of the anchor, positive example and negative example from the last layer of the DistilBERT encoder. We optimize for \\(max(||f(a) - f(n)|| - ||f(a) - f(p)|| + \alpha,0)\\)
|
24 |
|
25 |
where:
|
26 |
- \\( f(a)\\) is the [CLS] encoding of the anchor;
|