Add SetFit model

README.md

@@ -32,7 +32,7 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.8337531486146096
+      value: 0.7909319899244333
       name: Accuracy
 ---
 
@@ -64,17 +64,17 @@ The model has been trained using an efficient few-shot learning technique that i
 - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
 ### Model Labels
-| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
-|:------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-| 1.0   | <ul><li>'We believe that no company should prosper while violating the basic human rights of others whether through unlawful slavery, servitude, forced or compulsory labor, or otherwise exploitative means.'</li><li>'In addition to our onsite services, our ergonomics specialists provide ondemand virtual consulting to customers to help them assess their risks and offer effective solutions.'</li><li>'The Travelers Industrial Hygiene (IH) Laboratory, nationally accredited by the American Industrial Hygiene Association, provides specialized services to our commercial customers to help them understand occupational health exposures in order to minimize occupational diseases.'</li></ul>                                      |
-| 0.0   | <ul><li>'The decreases in the current period were offset, in part, by increases in conference and training expenditures incurred.'</li><li>'Environmental Responsibility As a core part of our business, we continually monitor, assess and respond not only to the risks but also to the opportunities posed by changing climate conditions.'</li><li>'Revenue derived from sales outside the Americas region increased primarily due to an increase from system sales in EIMEA and Japan, and an increase from services in EIMEA, Asia Pacific, and China, mostly offset by a decrease from sales of systems in China, which was largely due to COVID19related restrictions that occurred during the first quarter of fiscal year 2023.'</li></ul> |
+| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
+|:------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| 0.0   | <ul><li>'The concentration of our sales in our fourth fiscal quarter increases this impact as the revenue impact of most fourth fiscal quarter subscription sales will not be realized until the following fiscal year.'</li><li>'The deposit insurance fund of the FDIC insures deposit accounts in HomeTrust Bank up to 250,000 per separately insured deposit ownership right or category.'</li><li>'On 19 October 2020 the Company entered into a 25 million revolving credit facility agreement with State Street Bank International GmbH.'</li></ul>                      |
+| 1.0   | <ul><li>'The IH Laboratory supports our field organization and offers our customers a wide array of sampling and analysis protocols based on Occupational Safety and Health Administration (OSHA) and National Institute for Occupational Safety and Health methodologies.'</li><li>'We partnered with the Fair Wage Network to increase our understanding of the different definitions of fair wages and to benchmark against their extensive fair and living wage database.'</li><li>'Strategy is to ensure all our employees worldwide earn at least a fair wage.'</li></ul> |
 
 ## Evaluation
 
 ### Metrics
 | Label   | Accuracy |
 |:--------|:---------|
-| **all** | 0.8338   |
+| **all** | 0.7909   |
 
 ## Uses
 
@@ -92,7 +92,7 @@ Then you can load this model and run inference.
 from setfit import SetFitModel
 
 # Download from the 🤗 Hub
-model = SetFitModel.from_pretrained("mitra-mir/setfit-model-ESG-environmental")
+model = SetFitModel.from_pretrained("mitra-mir/setfit-model-ESG-social")
 # Run inference
 preds = model("and importance of the climate crisis requires everyone to play their part.")
 ```
@@ -126,12 +126,12 @@ preds = model("and importance of the climate crisis requires everyone to play th
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 3   | 25.4020 | 72  |
+| Word count   | 4   | 24.5578 | 112 |
 
 | Label | Training Sample Count |
 |:------|:----------------------|
-| 0.0   | 145                   |
-| 1.0   | 54                    |
+| 0.0   | 147                   |
+| 1.0   | 52                    |
 
 ### Training Hyperparameters
 - batch_size: (16, 16)
@@ -155,26 +155,16 @@ preds = model("and importance of the climate crisis requires everyone to play th
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0020 | 1    | 0.4091        | -               |
-| 0.1004 | 50   | 0.1992        | -               |
-| 0.2008 | 100  | 0.0104        | -               |
-| 0.3012 | 150  | 0.0006        | -               |
-| 0.4016 | 200  | 0.0003        | -               |
+| 0.0020 | 1    | 0.4072        | -               |
+| 0.1004 | 50   | 0.2038        | -               |
+| 0.2008 | 100  | 0.0155        | -               |
+| 0.3012 | 150  | 0.0003        | -               |
+| 0.4016 | 200  | 0.0002        | -               |
 | 0.5020 | 250  | 0.0002        | -               |
 | 0.6024 | 300  | 0.0002        | -               |
 | 0.7028 | 350  | 0.0001        | -               |
 | 0.8032 | 400  | 0.0001        | -               |
 | 0.9036 | 450  | 0.0001        | -               |
-| 0.0020 | 1    | 0.25          | -               |
-| 0.1004 | 50   | 0.349         | -               |
-| 0.2008 | 100  | 0.047         | -               |
-| 0.3012 | 150  | 0.0172        | -               |
-| 0.4016 | 200  | 0.0023        | -               |
-| 0.5020 | 250  | 0.0002        | -               |
-| 0.6024 | 300  | 0.0002        | -               |
-| 0.7028 | 350  | 0.0003        | -               |
-| 0.8032 | 400  | 0.0001        | -               |
-| 0.9036 | 450  | 0.0001        | -               |
 
 ### Framework Versions
 - Python: 3.11.6

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dd3b1582e58bc53f59b52d8cad2f826ff9c3cdf036b3fe5dbf925f1d2c63b8be
+oid sha256:50da4ffd74a3288675a738297bf886452f4464cc3c09aa0f31dff93dac0c676e
 size 437967672

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fe92f91d771b6ab8d8e49c0e15a1390fa36f80d478503309fe6bbff118bb3859
+oid sha256:7907f3692e3f72319578bb211d48e9bf90fbfe22333a29766170eed685fe548b
 size 6959