Add SetFit model

README.md

@@ -9,21 +9,18 @@ base_model: sentence-transformers/all-roberta-large-v1
 metrics:
 - accuracy
 widget:
-- text: ' Anytime I’d feel uncomfortable in gatherings I’d be like “haha fuck this
-    I’m OUTTTTTAAAA HEEERRREEE” then go outside to recollect myself for a few moments'
+- text: ' I would do this too but then I run the risk of meeting someone I know lol'
+- text: ' That''s kind of the nature of my volunteer work, but you could volunteer
+    with a food bank or boys  and girls club, which would involve more social interaction
+    Just breaking that cycle by going for a short walk around the neighbourhood is
+    a good idea'
+- text: ' Your body is trying to reduce weight by throwing up and having to go to
+    the bathroon, in case you need to run from the "enemy", so you''ll be lighter'
 - text: ' But even then, I didn''t have any other problems outside school I still
     had no friends at European school, I haven''t had any walks which I had constantly
     with my friends back in Ukraine'
-- text: ' I do try to get out a lot because of this especially now that it''s nicer
-    outside I go for runs every day almost but this last week like something threw
-    me off'
-- text: ' I literally do not leave the house, I will sometimes go in the garden but
-    no further So I just ran outside and back to the car'
-- text: ' I hated even going outside and seeing other people, because I just knew
-    how awkward and weird they would think I am for the way I looked and the way I
-    walked I hated even going outside and seeing other people, because I just knew
-    how awkward and weird they would think I am for the way I looked and the way I
-    walked'
+- text: ' I like art and nature but you can’t really talk about those for more than
+    a few seconds'
 pipeline_tag: text-classification
 inference: true
 model-index:
@@ -38,7 +35,7 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.43333333333333335
+      value: 0.3416666666666667
       name: Accuracy
 ---
 
@@ -70,19 +67,19 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
 ### Model Labels
-| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
-|:------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| 3.0   | <ul><li>' However, one day after lunch I was walking to his classroom to get to his class Every time I go outside I instantly get nervous'</li><li>' Very generic title, but i was just wondering, does anyone feel really safe and happy when hiding? For example everytime i go outside for work i get stared at'</li><li>" Also, i'm living in my parent's home for 20 years and although i know very few neighbors i feel stalked outside, and it's like everyone knows who i am (the building complex is in a dead-end street and all the windows make me anxious) Today i was leaving school's parking lot when i gave way to 2 other students - one looked at me in complete disgust while passing by, the other laughed at me (i even considered if i made some mistake) So i parked a bit more inclined to the road side than to the sidewalk (these are small streets and people usually park in the sidewalk) and other car couldn't pass to the end of the street"</li></ul> |
-| 0.0   | <ul><li>' Good to know that some people are in the same camp'</li><li>' If anything you should be thinking about wearing sun screen so you retain your good skin as it becomes your ally as you age outside'</li><li>" I'm sure if the worlds ever did clash that your friends would understand (few people actually enjoy being at work) and, worst case scenario, your coworkers would be surprised at your outgoing nature while around friends"</li></ul>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
-| 1.0   | <ul><li>" Now I'm not saying to go to a party on the spot, just go out, shop, take a walk in the park, that kind of thing Now I'm not saying to go to a party on the spot, just go out, shop, take a walk in the park, that kind of thing"</li><li>" Dairy can help a lot too! And for the boost and help that exercise makes, Go for jogs at night assuming you live in a safe area! Thats what I do! Between 1am and 3am nobody is ever out In my months of walking at night I've never seen someone even look at me from their car"</li><li>" That's kind of the nature of my volunteer work, but you could volunteer with a food bank or boys  and girls club, which would involve more social interaction Just breaking that cycle by going for a short walk around the neighbourhood is a good idea"</li></ul>                                                                                                                                                                     |
-| 2.0   | <ul><li>' It could be 100 degrees outside and I refused to take the hoodie off'</li><li>' I hated even going outside and seeing other people, because I just knew how awkward and weird they would think I am for the way I looked and the way I walked I hated even going outside and seeing other people, because I just knew how awkward and weird they would think I am for the way I looked and the way I walked'</li><li>' I like art and nature but you can’t really talk about those for more than a few seconds'</li></ul>                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
+| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
+|:------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| 1.0   | <ul><li>' and i do biking, i bike for atleast 20mins and towards the end i feel anxious free, less socially anxious too and i do biking, i bike for atleast 20mins and towards the end i feel anxious free, less socially anxious too'</li><li>" That's kind of the nature of my volunteer work, but you could volunteer with a food bank or boys  and girls club, which would involve more social interaction Just breaking that cycle by going for a short walk around the neighbourhood is a good idea"</li></ul> |
+| 2.0   | <ul><li>" I didn't go outside too much"</li><li>' I like art and nature but you can’t really talk about those for more than a few seconds'</li></ul>                                                                                                                                                                                                                                                                                                                                                                 |
+| 3.0   | <ul><li>" I don't know anyone in the city, I don't think I have enough courage to go outside alone"</li><li>" But even then, I didn't have any other problems outside school I still had no friends at European school, I haven't had any walks which I had constantly with my friends back in Ukraine"</li></ul>                                                                                                                                                                                                    |
+| 0.0   | <ul><li>' Your body is trying to reduce weight by throwing up and having to go to the bathroon, in case you need to run from the "enemy", so you\'ll be lighter'</li><li>' I would do this too but then I run the risk of meeting someone I know lol'</li></ul>                                                                                                                                                                                                                                                      |
 
 ## Evaluation
 
 ### Metrics
 | Label   | Accuracy |
 |:--------|:---------|
-| **all** | 0.4333   |
+| **all** | 0.3417   |
 
 ## Uses
 
@@ -102,7 +99,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("Omar-Nasr/setfitmodel")
 # Run inference
-preds = model(" I literally do not leave the house, I will sometimes go in the garden but no further So I just ran outside and back to the car")
+preds = model(" I would do this too but then I run the risk of meeting someone I know lol")
 ```
 
 <!--
@@ -134,14 +131,14 @@ preds = model(" I literally do not leave the house, I will sometimes go in the g
 ### Training Set Metrics
 | Training set | Min | Median | Max |
 |:-------------|:----|:-------|:----|
-| Word count   | 7   | 33.15  | 121 |
+| Word count   | 7   | 27.375 | 47  |
 
 | Label | Training Sample Count |
 |:------|:----------------------|
-| 0.0   | 10                    |
-| 1.0   | 10                    |
-| 2.0   | 10                    |
-| 3.0   | 10                    |
+| 0.0   | 2                     |
+| 1.0   | 2                     |
+| 2.0   | 2                     |
+| 3.0   | 2                     |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -163,13 +160,7 @@ preds = model(" I literally do not leave the house, I will sometimes go in the g
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0133 | 1    | 0.2699        | -               |
-| 0.6667 | 50   | 0.0497        | -               |
-| 1.3333 | 100  | 0.0012        | -               |
-| 2.0    | 150  | 0.0003        | -               |
-| 2.6667 | 200  | 0.0003        | -               |
-| 3.3333 | 250  | 0.0002        | -               |
-| 4.0    | 300  | 0.0001        | -               |
+| 0.3333 | 1    | 0.0708        | -               |
 
 ### Framework Versions
 - Python: 3.10.13

config_setfit.json

@@ -1,4 +1,4 @@
 {
-  "labels": null,
-  "normalize_embeddings": false
+  "normalize_embeddings": false,
+  "labels": null
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1f9d8937185092da4ad87406e8efb306c4adafec466f0878b00016e95a99d359
+oid sha256:914b970e09e034c7be1d72ee9d1c69d66f11251d67f58c62db0972b5736d0e38
 size 1421483904

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:653a6490d54676a06268211ad22fb93ef91390fe33b5d1dc097f6a92f3dafdac
+oid sha256:15bf413c69462d4ffdc39a30464d39f872fd6fdcca7666f5bdfe0e7fcfe51594
 size 33639