Add SetFit model

README.md

@@ -8,18 +8,13 @@ tags:
 metrics:
 - accuracy
 widget:
-- text: '"She sums up this theme with this pithy quote: \\\\\The first two letters
-    of Fundamentalist are F-U.\\\\\""  However, these are the parents who drop everything
-    to spend weeks caring for her when she is near death and all the friends from
-    her newly emancipated life are missing in action."""'
-- text: This was a christmas gift for my son , he couldn't wait to get it home and
-    set it up and watch movies and play video games on it...when he did he was speachless.
-- text: The shorts are made out of a good, durable material but not so stiff that
-    you feel like you can't move.
-- text: The only problem I knew I was going to have upfront was on the reciever end
-    of things as I needed an extra set of speaker outputs,but the Monoprice 4ch speaker
-    selector (#9995) took care of that deal.
-- text: This book is so good, I have to rave!
+- text: i honestly thought impossible at this point i feel pretty
+- text: i feel convinced that im going to shy away from whatever is really good for
+    me
+- text: i feel guilt that i should be more caring and im not
+- text: i found myself feeling nostalgic as i thought about the temporarily abandoned
+    little bishop chronicles
+- text: i am feeling very indecisive and spontaneous
 pipeline_tag: text-classification
 inference: true
 base_model: sentence-transformers/paraphrase-mpnet-base-v2
@@ -35,7 +30,7 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.7018
+      value: 0.439
       name: Accuracy
 ---
 
@@ -55,7 +50,7 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
 - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
 - **Maximum Sequence Length:** 512 tokens
-- **Number of Classes:** 2 classes
+- **Number of Classes:** 6 classes
 <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
 <!-- - **Language:** Unknown -->
 <!-- - **License:** Unknown -->
@@ -67,17 +62,21 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
 ### Model Labels
-| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                               |
-|:------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| 0     | <ul><li>'Bank and Gaza city of thompson falls in love with your kindle fire and rescue plan for the most important thing is the kindle fire department for sure to check it out for sure to use none of them'</li><li>"I really wanted green, really wanted beige, really wanted white didn't get any of those colors I got grey brown red instead."</li><li>'My only complaint is that I would like more colours please!!!'</li></ul> |
-| 1     | <ul><li>'I WOULD BUY MORE IN THE FUTURE FOR MY OWN REAL TREE.'</li><li>'I had to give this item one star but if there was a negative 5 star rating I would have chosen that.'</li><li>'The only thing I would have like for it to have a hole in the middle so I can put the stopper in without removing the mat.'</li></ul>                                                                                                           |
+| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
+|:------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| 4     | <ul><li>'i feel kind of strange'</li><li>'i am feeling pretty restless right now while typing this'</li><li>'i feel pressured when people say im going t beat you or whatever'</li></ul>                                                                                                                                                                                                                                                                                                                                               |
+| 3     | <ul><li>'i feel cranky and annoyed when i dont'</li><li>'i feel i did some thing impolite katanya'</li><li>'i feel like i should be offended but yawwwn'</li></ul>                                                                                                                                                                                                                                                                                                                                                                     |
+| 5     | <ul><li>'i was feeling an act of god at work in my life and it was an amazing feeling'</li><li>'i tween sat for my moms boss year old and year old boys this weekend id say babysit but that feels weird considering there were n'</li><li>'i started feeling funny and then friday i woke up sick as a dog'</li></ul>                                                                                                                                                                                                                 |
+| 0     | <ul><li>'i am from new jersey and this first drink was consumed at a post prom party so i feel it s appropriately lame'</li><li>'i feel inside cause life is like a game sometimes then you came around me the walls just disappeared nothing to surround me and keep me from my fears im unprotected see how ive opened up oh youve made me trust cause ive never felt like this before im naked around you does it show'</li><li>'i cant believe with that statement being said that im already feeling sexually deprived'</li></ul> |
+| 2     | <ul><li>'i suddenly feel that this is more than a sweet love song that every girls could sing in front of their boyfriends'</li><li>'i really wish i had the courage to drag a blade across my skin i wish i could do it i wish i could see the blood and feel that sweet release as it starts to pour out of my flesh and down my body'</li><li>'im sure they feel the more caring loving people in the kids lives the better'</li></ul>                                                                                              |
+| 1     | <ul><li>'i am not feeling particularly creative'</li><li>'id probably go with none on and hope that my date admires a confident girl who feels fine without makeup'</li><li>'i woke on saturday feeling a little brighter and was very keen to get outdoors after spending all day friday wallowing in self pity'</li></ul>                                                                                                                                                                                                            |
 
 ## Evaluation
 
 ### Metrics
 | Label   | Accuracy |
 |:--------|:---------|
-| **all** | 0.7018   |
+| **all** | 0.439    |
 
 ## Uses
 
@@ -97,7 +96,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("vidhi0206/setfit-paraphrase-mpnet-amazoncf")
 # Run inference
-preds = model("This book is so good, I have to rave!")
+preds = model("i am feeling very indecisive and spontaneous")
 ```
 
 <!--
@@ -127,14 +126,18 @@ preds = model("This book is so good, I have to rave!")
 ## Training Details
 
 ### Training Set Metrics
-| Training set | Min | Median | Max |
-|:-------------|:----|:-------|:----|
-| Word count   | 9   | 19.875 | 39  |
+| Training set | Min | Median  | Max |
+|:-------------|:----|:--------|:----|
+| Word count   | 4   | 17.6458 | 55  |
 
 | Label | Training Sample Count |
 |:------|:----------------------|
 | 0     | 8                     |
 | 1     | 8                     |
+| 2     | 8                     |
+| 3     | 8                     |
+| 4     | 8                     |
+| 5     | 8                     |
 
 ### Training Hyperparameters
 - batch_size: (8, 8)
@@ -157,8 +160,11 @@ preds = model("This book is so good, I have to rave!")
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0125 | 1    | 0.1979        | -               |
-| 0.625  | 50   | 0.0022        | -               |
+| 0.0042 | 1    | 0.2972        | -               |
+| 0.2083 | 50   | 0.1452        | -               |
+| 0.4167 | 100  | 0.0452        | -               |
+| 0.625  | 150  | 0.0085        | -               |
+| 0.8333 | 200  | 0.0011        | -               |
 
 ### Framework Versions
 - Python: 3.8.10

config_setfit.json

@@ -1,4 +1,4 @@
 {
-  "labels": null,
-  "normalize_embeddings": false
+  "normalize_embeddings": false,
+  "labels": null
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e387cf2fc21345adeca754210c1fa63e69432279892bf6f5cca41406c20bdf69
+oid sha256:8553bfa05ce749a7010a57a4d0b20bff04b969b5fdc6413b47d22891a6ca9db6
 size 437967672

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1386ef67f86c97814c5157951eb1fcb2595b5b1a1fe627359d8ec7df67e03123
-size 6991
+oid sha256:39280de3dcf2dda1aa46cfec6d4343b1230b26c29b75fa471b5e02a8e663f299
+size 37783