Add SetFit model

README.md

@@ -8,13 +8,14 @@ tags:
 metrics:
 - accuracy
 widget:
+- text: Sarah has 10 stickers. She gives 3 to her friend. What fraction of her stickers
+    did Sarah give away?
+- text: If you have 8 apples and you eat 3 of them, how many apples do you have left?
+- text: 'What simple strategy could you use to solve this word problem: ''Mike had
+    9 candies...'''
 - text: If you have 20 marbles and you give 5 of them to your friend, how many marbles
     do you have left?
-- text: If a dozen eggs cost $3, how much do 3 dozen eggs cost?
-- text: If a train leaves the station at 9:00 AM and arrives at its destination at
-    11:30 AM, how long is the journey?
-- text: What is the chemical symbol for water?
-- text: Who painted the Mona Lisa?
+- text: What is the name of the holiday that celebrates workers in September?
 pipeline_tag: text-classification
 inference: true
 base_model: sentence-transformers/all-MiniLM-L6-v2
@@ -62,10 +63,10 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
 ### Model Labels
-| Label    | Examples                                                                                                                                                                                                     |
-|:---------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| non_math | <ul><li>'What do you call a baby kangaroo?'</li><li>'What is the currency used in Japan?'</li><li>'What is the smallest planet in our solar system?'</li></ul>                                               |
-| math     | <ul><li>'What is the number that comes after 15?'</li><li>'What is the sum of 18 and 27?'</li><li>'There are 8 apples on the table. If you add 3 more apples, how many apples are there in total?'</li></ul> |
+| Label    | Examples                                                                                                                                                                                                                                                                                                      |
+|:---------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| math     | <ul><li>'There are 10 frogs on a log. Some frogs jumped off and now there are 6 frogs left. How can you show this using an equation?'</li><li>'Sarah has 9 stickers. She gives 3 stickers to her brother. How many stickers does Sarah have left?'</li><li>'Which 3D shape has one curved surface?'</li></ul> |
+| non_math | <ul><li>'What is the currency used in Japan?'</li><li>'What do you call a baby kangaroo?'</li><li>'What is the capital city of Canada, our neighbor to the north?'</li></ul>                                                                                                                                  |
 
 ## Evaluation
 
@@ -92,7 +93,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("serdarcaglar/primary-school-math-question")
 # Run inference
-preds = model("Who painted the Mona Lisa?")
+preds = model("What is the name of the holiday that celebrates workers in September?")
 ```
 
 <!--
@@ -122,14 +123,14 @@ preds = model("Who painted the Mona Lisa?")
 ## Training Details
 
 ### Training Set Metrics
-| Training set | Min | Median  | Max |
-|:-------------|:----|:--------|:----|
-| Word count   | 3   | 10.8406 | 23  |
+| Training set | Min | Median | Max |
+|:-------------|:----|:-------|:----|
+| Word count   | 3   | 13.765 | 33  |
 
 | Label    | Training Sample Count |
 |:---------|:----------------------|
-| math     | 40                    |
-| non_math | 29                    |
+| math     | 141                   |
+| non_math | 59                    |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -150,12 +151,19 @@ preds = model("Who painted the Mona Lisa?")
 - load_best_model_at_end: False
 
 ### Training Results
-| Epoch  | Step | Training Loss | Validation Loss |
-|:------:|:----:|:-------------:|:---------------:|
-| 0.0058 | 1    | 0.2737        | -               |
-| 0.2890 | 50   | 0.0212        | -               |
-| 0.5780 | 100  | 0.0037        | -               |
-| 0.8671 | 150  | 0.0023        | -               |
+| Epoch | Step | Training Loss | Validation Loss |
+|:-----:|:----:|:-------------:|:---------------:|
+| 0.002 | 1    | 0.3356        | -               |
+| 0.1   | 50   | 0.0577        | -               |
+| 0.2   | 100  | 0.0053        | -               |
+| 0.3   | 150  | 0.0025        | -               |
+| 0.4   | 200  | 0.0016        | -               |
+| 0.5   | 250  | 0.0008        | -               |
+| 0.6   | 300  | 0.0003        | -               |
+| 0.7   | 350  | 0.0005        | -               |
+| 0.8   | 400  | 0.0006        | -               |
+| 0.9   | 450  | 0.0005        | -               |
+| 1.0   | 500  | 0.0009        | -               |
 
 ### Framework Versions
 - Python: 3.10.12

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b23a7b11036a5a3ed6d7fa78520930502934b3c0fdf69c69a7dae06e24a31106
+oid sha256:a198728b33c01021393ca5286275dc9f7ba1a04fbc1c249988448e4a66495423
 size 90864192

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d0cae6363f78c05e9e530147c0a21ae4a56abfac59b6f4fb1578ee8daf34680e
+oid sha256:e83b3814b7d0982f27fc588fdb5cf8ddfc79d878193256a93f662dc8a86d6e02
 size 3967