Add SetFit model

README.md

@@ -8,12 +8,13 @@ tags:
 metrics:
 - accuracy
 widget:
-- text: Can you name three different types of fruits?
-- text: What is the capital city of your state?
-- text: If 2 apples cost $1, how much would 5 apples cost?
-- text: John had 8 marbles. He lost 4 marbles and then got 3 new ones. How many marbles
-    does John have now?
-- text: What is the name of the civil rights leader who said 'I have a dream'?
+- text: If you have 3 red apples and 2 green apples, how many apples do you have in
+    total?
+- text: Can you name three different colors?
+- text: If you have 15 cookies and you share them equally among 3 friends, how many
+    cookies does each friend get?
+- text: Which state is known as the Sunshine State?
+- text: John has 2 more toy cars than Sam. If Sam has 6 cars, how many does John have?
 pipeline_tag: text-classification
 inference: true
 base_model: sentence-transformers/all-MiniLM-L6-v2
@@ -61,10 +62,10 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
 ### Model Labels
-| Label    | Examples                                                                                                                                                                                                                                                                            |
-|:---------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| math     | <ul><li>'Which unit would you use to measure how much milk you need for your cereal: cups or gallons?'</li><li>'What is the volume of a cube with side length 4 cm?'</li><li>'If school starts at 8:30 AM and ends at 3:15 PM, how many hours are there in a school day?'</li></ul> |
-| non_math | <ul><li>'What is the name of the long river that runs through the middle of the US?'</li><li>'What do we call the action of objects changing their position?'</li><li>'What is the currency used in Japan?'</li></ul>                                                               |
+| Label    | Examples                                                                                                                                                                                                                                                                                            |
+|:---------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| non_math | <ul><li>'What is the largest ocean on Earth?'</li><li>'What is the name of the galaxy that contains our solar system?'</li><li>'What is the name of the ocean on the east coast of the United States?'</li></ul>                                                                                    |
+| math     | <ul><li>'Which is more: 7 or 9?'</li><li>'There are 20 chocolates, and you want to share them equally among 4 friends. How many chocolates will each friend get?'</li><li>"If the teacher says 'Alice has 3 more apples than Bob', how can you represent this using numbers and symbols?"</li></ul> |
 
 ## Evaluation
 
@@ -91,7 +92,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("serdarcaglar/primary-school-math-question")
 # Run inference
-preds = model("What is the capital city of your state?")
+preds = model("Can you name three different colors?")
 ```
 
 <!--
@@ -123,12 +124,12 @@ preds = model("What is the capital city of your state?")
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 1   | 12.5378 | 33  |
+| Word count   | 1   | 12.4979 | 33  |
 
 | Label    | Training Sample Count |
 |:---------|:----------------------|
-| math     | 141                   |
-| non_math | 97                    |
+| math     | 142                   |
+| non_math | 99                    |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -151,18 +152,19 @@ preds = model("What is the capital city of your state?")
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0017 | 1    | 0.3115        | -               |
-| 0.0840 | 50   | 0.1498        | -               |
-| 0.1681 | 100  | 0.0127        | -               |
-| 0.2521 | 150  | 0.0056        | -               |
-| 0.3361 | 200  | 0.0019        | -               |
-| 0.4202 | 250  | 0.0007        | -               |
-| 0.5042 | 300  | 0.0016        | -               |
-| 0.5882 | 350  | 0.0019        | -               |
-| 0.6723 | 400  | 0.0005        | -               |
-| 0.7563 | 450  | 0.0009        | -               |
-| 0.8403 | 500  | 0.0009        | -               |
-| 0.9244 | 550  | 0.0008        | -               |
+| 0.0017 | 1    | 0.336         | -               |
+| 0.0829 | 50   | 0.1156        | -               |
+| 0.1658 | 100  | 0.0062        | -               |
+| 0.2488 | 150  | 0.0026        | -               |
+| 0.3317 | 200  | 0.0025        | -               |
+| 0.4146 | 250  | 0.0022        | -               |
+| 0.4975 | 300  | 0.0024        | -               |
+| 0.5804 | 350  | 0.0009        | -               |
+| 0.6633 | 400  | 0.0009        | -               |
+| 0.7463 | 450  | 0.0007        | -               |
+| 0.8292 | 500  | 0.0004        | -               |
+| 0.9121 | 550  | 0.0002        | -               |
+| 0.9950 | 600  | 0.0007        | -               |
 
 ### Framework Versions
 - Python: 3.10.12

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "serdarcaglar/primary-school-math-question",
+  "_name_or_path": "sentence-transformers/all-MiniLM-L6-v2",
   "architectures": [
     "BertModel"
   ],

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7c383fc411cebd9c2fd39b6391cd0c511b5c703e0c0b1cba4b768b9206d2cdb3
+oid sha256:98045fe64d40afc0b7c7b45aab38f4d696c053bc2af9d6c3f279dc6b4c975a62
 size 90864192

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:54154be49871204f7afa49967c5b22cf6d928cb8250214a377450976b36b7891
+oid sha256:429ea5b4f0ed3110e9268c8fe2f2e6de0c91c07821cdeceef6f8722e304647f1
 size 3967