Add SetFit model

README.md

@@ -8,11 +8,14 @@ tags:
 metrics:
 - accuracy
 widget:
-- text: Artificial intelligence is changing the way we live and work.
-- text: The university is offering scholarships for students in financial need.
-- text: The new Marvel movie is breaking box office records.
-- text: The annual Met Gala is a major event in the fashion world.
-- text: Visiting the Grand Canyon is a breathtaking experience.
+- text: The development of smart cities is leveraging technology to improve urban
+    living conditions.
+- text: Climate change is causing a significant rise in sea levels.
+- text: Fans are speculating about the plot of the upcoming season of Stranger Things.
+- text: Fashion branding and marketing campaigns shape consumer perceptions and influence
+    purchasing decisions.
+- text: Volunteering abroad provides a unique opportunity to experience different
+    cultures while giving back to society.
 pipeline_tag: text-classification
 inference: true
 base_model: sentence-transformers/paraphrase-mpnet-base-v2
@@ -79,7 +82,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("EmeraldMP/ANLP_kaggle")
 # Run inference
-preds = model("The new Marvel movie is breaking box office records.")
+preds = model("Climate change is causing a significant rise in sea levels.")
 ```
 
 <!--
@@ -111,22 +114,22 @@ preds = model("The new Marvel movie is breaking box office records.")
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 8   | 11.0833 | 17  |
+| Word count   | 7   | 12.8073 | 24  |
 
 | Label         | Training Sample Count |
 |:--------------|:----------------------|
-| Education     | 3                     |
-| Entertainment | 3                     |
-| Environment   | 3                     |
-| Fashion       | 3                     |
-| Finance       | 3                     |
-| Food          | 3                     |
-| Health        | 3                     |
-| Politics      | 3                     |
-| Science       | 3                     |
-| Sports        | 3                     |
-| Technology    | 3                     |
-| Travel        | 3                     |
+| Education     | 23                    |
+| Entertainment | 23                    |
+| Environment   | 23                    |
+| Fashion       | 23                    |
+| Finance       | 23                    |
+| Food          | 23                    |
+| Health        | 23                    |
+| Politics      | 22                    |
+| Science       | 23                    |
+| Sports        | 23                    |
+| Technology    | 23                    |
+| Travel        | 23                    |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -149,8 +152,20 @@ preds = model("The new Marvel movie is breaking box office records.")
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0111 | 1    | 0.1765        | -               |
-| 0.5556 | 50   | 0.0137        | -               |
+| 0.0015 | 1    | 0.2839        | -               |
+| 0.0727 | 50   | 0.1245        | -               |
+| 0.1453 | 100  | 0.1334        | -               |
+| 0.2180 | 150  | 0.0142        | -               |
+| 0.2907 | 200  | 0.0046        | -               |
+| 0.3634 | 250  | 0.0024        | -               |
+| 0.4360 | 300  | 0.0019        | -               |
+| 0.5087 | 350  | 0.0011        | -               |
+| 0.5814 | 400  | 0.0013        | -               |
+| 0.6541 | 450  | 0.0007        | -               |
+| 0.7267 | 500  | 0.0011        | -               |
+| 0.7994 | 550  | 0.001         | -               |
+| 0.8721 | 600  | 0.001         | -               |
+| 0.9448 | 650  | 0.0004        | -               |
 
 ### Framework Versions
 - Python: 3.10.12

config_setfit.json

@@ -1,4 +1,5 @@
 {
+  "normalize_embeddings": false,
   "labels": [
     "Education",
     "Entertainment",
@@ -12,6 +13,5 @@
     "Sports",
     "Technology",
     "Travel"
-  ],
-  "normalize_embeddings": false
+  ]
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9ead0296fbdd6209f7b8b0298059ca8311d854fab898a50c077becf041ad68f8
+oid sha256:5562ac9f8560da754bdeb3dfb4b75b559482755a128183e84a01e27901ca23c5
 size 437967672

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6ae16cf8f25bb088110133fcf0b0b18b7c0e42a670b9046ba90cc5d642b4bba5
+oid sha256:e1e6987a92cd9d6f2c7696ed3da31b347bdab0c54b8c7205ab12eaf91a3cc938
 size 75287