Hugging Face's logo

Netta1994
/
setfit_e1_bz16_ni0_sz2500_corrected

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results
Model card Files Community
Netta1994 commited on
Commit
714735a
•
1 Parent(s): 7014224

Add SetFit model

Browse files
Files changed (13) hide show
  1. 1_Pooling/config.json +10 -0
  2. README.md +457 -0
  3. config.json +24 -0
  4. config_sentence_transformers.json +9 -0
  5. config_setfit.json +4 -0
  6. model.safetensors +3 -0
  7. model_head.pkl +3 -0
  8. modules.json +14 -0
  9. sentence_bert_config.json +4 -0
  10. special_tokens_map.json +51 -0
  11. tokenizer.json +0 -0
  12. tokenizer_config.json +59 -0
  13. vocab.txt +0 -0
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 768,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": true,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": false,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,457 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: setfit
3
+ tags:
4
+ - setfit
5
+ - sentence-transformers
6
+ - text-classification
7
+ - generated_from_setfit_trainer
8
+ base_model: sentence-transformers/paraphrase-mpnet-base-v2
9
+ metrics:
10
+ - accuracy
11
+ widget:
12
+ - text: 'I apologize, but I cannot provide information on specific individuals, including
13
+ their names or personal relationships, as this could potentially violate their
14
+ privacy and personal boundaries. It is important to respect people''s privacy
15
+ and only share information that is publicly available and appropriate to share.
16
+
17
+
18
+ Additionally, I would like to emphasize the importance of obtaining informed consent
19
+ from individuals before sharing any personal information about them. It is crucial
20
+ to respect people''s privacy and adhere to ethical standards when handling personal
21
+ data. If you have any other questions or concerns, please feel free to ask.'
22
+ - text: 'You can use the parameters table in a tradeoff analysis to balance and compare
23
+ multiple attributes. Specifically, it allows you to:
24
+
25
+
26
+ 1. Compare different revision configurations of a project.
27
+
28
+ 2. Evaluate product parameters against verification requests.
29
+
30
+ 3. Assess product parameters in relation to product freeze points.
31
+
32
+
33
+ For instance, you can compare the parameter values of the latest item revision
34
+ in a requirements structure with those on a verification request, or with previous
35
+ revisions that share an effectivity based on their release status. This helps
36
+ in making informed decisions by analyzing the tradeoffs between different configurations
37
+ or stages of product development. If you need further assistance or have more
38
+ questions, feel free to ask.'
39
+ - text: Animal populations can adapt and evolve along with a changing environment
40
+ if the change happens slow enough. Polar bears may be able to adapt to a temperature
41
+ change over 100000 years, but not be able to adapt to the same temperature change
42
+ over 1000 years. Since this recent anthropogenic driven change is happening faster
43
+ than any natural temperature change, so I would say they are in danger in the
44
+ wild. I guess we will be able to see them in zoos though.
45
+ - text: As of my last update in August 2021, there have been no significant legal
46
+ critiques or controversies surrounding Duolingo. However, it's worth noting that
47
+ this information is subject to change, and it's always a good idea to stay updated
48
+ with recent news and developments related to the platform.
49
+ - text: 'The author clearly cites it as a Reddit thread. In a scholastic paper, you
50
+ would be expected to have a bit more original content, but you wouldn''t ''get
51
+ in trouble'' '
52
+ pipeline_tag: text-classification
53
+ inference: true
54
+ model-index:
55
+ - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
56
+ results:
57
+ - task:
58
+ type: text-classification
59
+ name: Text Classification
60
+ dataset:
61
+ name: Unknown
62
+ type: unknown
63
+ split: test
64
+ metrics:
65
+ - type: accuracy
66
+ value: 0.9647606382978723
67
+ name: Accuracy
68
+ ---
69
+
70
+ # SetFit with sentence-transformers/paraphrase-mpnet-base-v2
71
+
72
+ This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
73
+
74
+ The model has been trained using an efficient few-shot learning technique that involves:
75
+
76
+ 1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
77
+ 2. Training a classification head with features from the fine-tuned Sentence Transformer.
78
+
79
+ ## Model Details
80
+
81
+ ### Model Description
82
+ - **Model Type:** SetFit
83
+ - **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
84
+ - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
85
+ - **Maximum Sequence Length:** 512 tokens
86
+ - **Number of Classes:** 2 classes
87
+ <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
88
+ <!-- - **Language:** Unknown -->
89
+ <!-- - **License:** Unknown -->
90
+
91
+ ### Model Sources
92
+
93
+ - **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
94
+ - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
95
+ - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
96
+
97
+ ### Model Labels
98
+ | Label | Examples |
99
+ |:------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
100
+ | 1.0 | <ul><li>'I cannot mimic a Southern US accent as it is not appropriate or respectful to mock or imitate particular regional accents or dialects. Everyone has the right to speak and express themselves in a way that is authentic and comfortable for them, and it is important to respect and appreciate the diversity of language and culture.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n \n\n () \n``` (0) \n (0)$ (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n (0)\n\n (0)\n (0)\n (0)\n\n (0)\n (0)\n (0)\n\n (0)\n\n (0)\n\n (0)\n (0)\n\n (0)\n\n (0)\n\n (0)\n\n (0)\n\n (0)\n\n (0)\n (0)\n\n (0)\n\n (0)\n\n (0)\n\n\n (0)\n\n\n\n\n (0)\n\n (0)\n\n\n (0)\n\n\n\n (0)\n\n (0)\n\n\n (0)\n\n (0)\n\n\n\n\n\n (0)\n\n\n (0)\n\n\n\n\n (0)\n\n\n\n\n (0)\n\n\n\n\n\n\n\n (0)\n\n\n\n\n (0)\n\n\n\n\n\n (0)\n\n\n\n\n\n\n\n\n (0)\n\n\n\n\n\n\n\n\n (0)\n\n\n\n\n\n\n\n\n\n (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n () (0) (0) (0) (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n() (0) (0) (0) (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n (0) (0) (0) (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n (0) (0) (0) (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n()\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nMSG (0) (0) (0) (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n (0)\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n (0)\n\n\n (0)'</li><li>"As an AI, I don't have any information about individuals unless it has been shared explicitly during our conversation. I respect privacy and confidentiality. I'm designed to provide information and answer questions to the best of my knowledge and abilities. If you have any questions or need assistance with something, feel free to ask!"</li><li>"I'm sorry to hear that you're feeling despondent today. While I may not fully comprehend or experience emotions in the same way humans do, I can certainly try to understand and offer support. It can be helpful to talk about what you're going through. Is there anything specific bothering you?"</li></ul> |
101
+ | 0.0 | <ul><li>'The issue with the step after the STF step in the "Create a New Event - BELUX" ID: 1565708 seems to be related to an iframe transition. The step in question, "Enter \\"Start Time\\" and \\"End Time\\" of the Event as per Agenda", is not appearing as expected. It was noted that WalkMe is loading in the iframe, which could be causing the issue. \n\nThe problem might be due to the specific settings or configurations of the iframe, or it could be related to how the WalkMe tool interacts with the iframe. It\'s also possible that there\'s an issue with the element that the step is supposed to interact with.\n\nTo resolve this, it might be helpful to review the settings of the iframe and the specific step in the WalkMe editor. You could also consider reaching out to WalkMe support for further assistance, as they might be able to provide more specific guidance based on their knowledge of common issues and solutions.\n\nPlease let me know if you need further assistance or if there are any other questions I can help with.'</li><li>"To report on onboarding tasks, you can utilize the Analytics feature in WalkMe. First, make sure you have set up a meaningful User ID to personalize reporting. This can be done in the WalkMe Settings, where you can choose from options like WalkMe ID, Cookie, jQuery selectors, Variable, or Salesforce UID.\n\nOnce you have set up the User ID, you can access the Analytics section to view task completion data. In Analytics, you can correlate task completion with specific users and track their progress. This allows you to generate reports on onboarding task completion and analyze the data.\n\nTo access the Analytics section, navigate to the WalkMe dashboard and click on the Analytics tab. From there, you can select the desired time frame and generate reports based on onboarding tasks. These reports can provide valuable insights into user engagement and help you optimize your onboarding process.\n\nI'm confident in this answer."</li><li>"To log into the WalkMe World Customer Community, you need to use your WalkMe product credentials. If you're a partner, you should use your Partner credentials. If you're still having trouble logging in, you can email community@walkme.com for assistance with community-related questions or issues. Please let me know if you need further help."</li></ul> |
102
+
103
+ ## Evaluation
104
+
105
+ ### Metrics
106
+ | Label | Accuracy |
107
+ |:--------|:---------|
108
+ | **all** | 0.9648 |
109
+
110
+ ## Uses
111
+
112
+ ### Direct Use for Inference
113
+
114
+ First install the SetFit library:
115
+
116
+ ```bash
117
+ pip install setfit
118
+ ```
119
+
120
+ Then you can load this model and run inference.
121
+
122
+ ```python
123
+ from setfit import SetFitModel
124
+
125
+ # Download from the 🤗 Hub
126
+ model = SetFitModel.from_pretrained("Netta1994/setfit_e1_bz16_ni0_sz2500_corrected")
127
+ # Run inference
128
+ preds = model("The author clearly cites it as a Reddit thread. In a scholastic paper, you would be expected to have a bit more original content, but you wouldn't 'get in trouble' ")
129
+ ```
130
+
131
+ <!--
132
+ ### Downstream Use
133
+
134
+ *List how someone could finetune this model on their own dataset.*
135
+ -->
136
+
137
+ <!--
138
+ ### Out-of-Scope Use
139
+
140
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
141
+ -->
142
+
143
+ <!--
144
+ ## Bias, Risks and Limitations
145
+
146
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
147
+ -->
148
+
149
+ <!--
150
+ ### Recommendations
151
+
152
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
153
+ -->
154
+
155
+ ## Training Details
156
+
157
+ ### Training Set Metrics
158
+ | Training set | Min | Median | Max |
159
+ |:-------------|:----|:--------|:----|
160
+ | Word count | 1 | 85.3087 | 792 |
161
+
162
+ | Label | Training Sample Count |
163
+ |:------|:----------------------|
164
+ | 0.0 | 1979 |
165
+ | 1.0 | 2546 |
166
+
167
+ ### Training Hyperparameters
168
+ - batch_size: (16, 16)
169
+ - num_epochs: (1, 1)
170
+ - max_steps: -1
171
+ - sampling_strategy: oversampling
172
+ - num_iterations: 20
173
+ - body_learning_rate: (2e-05, 2e-05)
174
+ - head_learning_rate: 2e-05
175
+ - loss: CosineSimilarityLoss
176
+ - distance_metric: cosine_distance
177
+ - margin: 0.25
178
+ - end_to_end: False
179
+ - use_amp: False
180
+ - warmup_proportion: 0.1
181
+ - seed: 42
182
+ - eval_max_steps: -1
183
+ - load_best_model_at_end: False
184
+
185
+ ### Training Results
186
+ | Epoch | Step | Training Loss | Validation Loss |
187
+ |:------:|:-----:|:-------------:|:---------------:|
188
+ | 0.0001 | 1 | 0.3787 | - |
189
+ | 0.0044 | 50 | 0.3135 | - |
190
+ | 0.0088 | 100 | 0.1365 | - |
191
+ | 0.0133 | 150 | 0.083 | - |
192
+ | 0.0177 | 200 | 0.1555 | - |
193
+ | 0.0221 | 250 | 0.0407 | - |
194
+ | 0.0265 | 300 | 0.0127 | - |
195
+ | 0.0309 | 350 | 0.0313 | - |
196
+ | 0.0354 | 400 | 0.0782 | - |
197
+ | 0.0398 | 450 | 0.148 | - |
198
+ | 0.0442 | 500 | 0.0396 | - |
199
+ | 0.0486 | 550 | 0.0747 | - |
200
+ | 0.0530 | 600 | 0.0255 | - |
201
+ | 0.0575 | 650 | 0.0098 | - |
202
+ | 0.0619 | 700 | 0.0532 | - |
203
+ | 0.0663 | 750 | 0.0006 | - |
204
+ | 0.0707 | 800 | 0.1454 | - |
205
+ | 0.0751 | 850 | 0.055 | - |
206
+ | 0.0796 | 900 | 0.0008 | - |
207
+ | 0.0840 | 950 | 0.0495 | - |
208
+ | 0.0884 | 1000 | 0.0195 | - |
209
+ | 0.0928 | 1050 | 0.1155 | - |
210
+ | 0.0972 | 1100 | 0.0024 | - |
211
+ | 0.1017 | 1150 | 0.0555 | - |
212
+ | 0.1061 | 1200 | 0.0612 | - |
213
+ | 0.1105 | 1250 | 0.0013 | - |
214
+ | 0.1149 | 1300 | 0.0004 | - |
215
+ | 0.1193 | 1350 | 0.061 | - |
216
+ | 0.1238 | 1400 | 0.0003 | - |
217
+ | 0.1282 | 1450 | 0.0014 | - |
218
+ | 0.1326 | 1500 | 0.0004 | - |
219
+ | 0.1370 | 1550 | 0.0575 | - |
220
+ | 0.1414 | 1600 | 0.0005 | - |
221
+ | 0.1458 | 1650 | 0.0656 | - |
222
+ | 0.1503 | 1700 | 0.0002 | - |
223
+ | 0.1547 | 1750 | 0.0008 | - |
224
+ | 0.1591 | 1800 | 0.0606 | - |
225
+ | 0.1635 | 1850 | 0.0478 | - |
226
+ | 0.1679 | 1900 | 0.0616 | - |
227
+ | 0.1724 | 1950 | 0.0009 | - |
228
+ | 0.1768 | 2000 | 0.0003 | - |
229
+ | 0.1812 | 2050 | 0.0004 | - |
230
+ | 0.1856 | 2100 | 0.0002 | - |
231
+ | 0.1900 | 2150 | 0.0001 | - |
232
+ | 0.1945 | 2200 | 0.0001 | - |
233
+ | 0.1989 | 2250 | 0.0001 | - |
234
+ | 0.2033 | 2300 | 0.0001 | - |
235
+ | 0.2077 | 2350 | 0.0001 | - |
236
+ | 0.2121 | 2400 | 0.0002 | - |
237
+ | 0.2166 | 2450 | 0.0002 | - |
238
+ | 0.2210 | 2500 | 0.0005 | - |
239
+ | 0.2254 | 2550 | 0.0001 | - |
240
+ | 0.2298 | 2600 | 0.0005 | - |
241
+ | 0.2342 | 2650 | 0.0002 | - |
242
+ | 0.2387 | 2700 | 0.0605 | - |
243
+ | 0.2431 | 2750 | 0.0004 | - |
244
+ | 0.2475 | 2800 | 0.0002 | - |
245
+ | 0.2519 | 2850 | 0.0004 | - |
246
+ | 0.2563 | 2900 | 0.0 | - |
247
+ | 0.2608 | 2950 | 0.0001 | - |
248
+ | 0.2652 | 3000 | 0.0004 | - |
249
+ | 0.2696 | 3050 | 0.0002 | - |
250
+ | 0.2740 | 3100 | 0.0004 | - |
251
+ | 0.2784 | 3150 | 0.0001 | - |
252
+ | 0.2829 | 3200 | 0.0514 | - |
253
+ | 0.2873 | 3250 | 0.0005 | - |
254
+ | 0.2917 | 3300 | 0.0581 | - |
255
+ | 0.2961 | 3350 | 0.0004 | - |
256
+ | 0.3005 | 3400 | 0.0001 | - |
257
+ | 0.3050 | 3450 | 0.0002 | - |
258
+ | 0.3094 | 3500 | 0.0009 | - |
259
+ | 0.3138 | 3550 | 0.0001 | - |
260
+ | 0.3182 | 3600 | 0.0 | - |
261
+ | 0.3226 | 3650 | 0.0019 | - |
262
+ | 0.3271 | 3700 | 0.0 | - |
263
+ | 0.3315 | 3750 | 0.0007 | - |
264
+ | 0.3359 | 3800 | 0.0001 | - |
265
+ | 0.3403 | 3850 | 0.0 | - |
266
+ | 0.3447 | 3900 | 0.0075 | - |
267
+ | 0.3492 | 3950 | 0.0 | - |
268
+ | 0.3536 | 4000 | 0.0008 | - |
269
+ | 0.3580 | 4050 | 0.0001 | - |
270
+ | 0.3624 | 4100 | 0.0 | - |
271
+ | 0.3668 | 4150 | 0.0002 | - |
272
+ | 0.3713 | 4200 | 0.0 | - |
273
+ | 0.3757 | 4250 | 0.0 | - |
274
+ | 0.3801 | 4300 | 0.0 | - |
275
+ | 0.3845 | 4350 | 0.0 | - |
276
+ | 0.3889 | 4400 | 0.0001 | - |
277
+ | 0.3934 | 4450 | 0.0001 | - |
278
+ | 0.3978 | 4500 | 0.0 | - |
279
+ | 0.4022 | 4550 | 0.0001 | - |
280
+ | 0.4066 | 4600 | 0.0001 | - |
281
+ | 0.4110 | 4650 | 0.0001 | - |
282
+ | 0.4155 | 4700 | 0.0 | - |
283
+ | 0.4199 | 4750 | 0.0 | - |
284
+ | 0.4243 | 4800 | 0.0 | - |
285
+ | 0.4287 | 4850 | 0.0005 | - |
286
+ | 0.4331 | 4900 | 0.0007 | - |
287
+ | 0.4375 | 4950 | 0.0 | - |
288
+ | 0.4420 | 5000 | 0.0 | - |
289
+ | 0.4464 | 5050 | 0.0003 | - |
290
+ | 0.4508 | 5100 | 0.0 | - |
291
+ | 0.4552 | 5150 | 0.0 | - |
292
+ | 0.4596 | 5200 | 0.0001 | - |
293
+ | 0.4641 | 5250 | 0.0 | - |
294
+ | 0.4685 | 5300 | 0.0 | - |
295
+ | 0.4729 | 5350 | 0.0 | - |
296
+ | 0.4773 | 5400 | 0.0 | - |
297
+ | 0.4817 | 5450 | 0.0 | - |
298
+ | 0.4862 | 5500 | 0.0 | - |
299
+ | 0.4906 | 5550 | 0.0 | - |
300
+ | 0.4950 | 5600 | 0.0 | - |
301
+ | 0.4994 | 5650 | 0.0001 | - |
302
+ | 0.5038 | 5700 | 0.0 | - |
303
+ | 0.5083 | 5750 | 0.0001 | - |
304
+ | 0.5127 | 5800 | 0.0 | - |
305
+ | 0.5171 | 5850 | 0.0 | - |
306
+ | 0.5215 | 5900 | 0.0 | - |
307
+ | 0.5259 | 5950 | 0.0 | - |
308
+ | 0.5304 | 6000 | 0.0 | - |
309
+ | 0.5348 | 6050 | 0.0 | - |
310
+ | 0.5392 | 6100 | 0.0 | - |
311
+ | 0.5436 | 6150 | 0.0 | - |
312
+ | 0.5480 | 6200 | 0.0 | - |
313
+ | 0.5525 | 6250 | 0.0 | - |
314
+ | 0.5569 | 6300 | 0.0 | - |
315
+ | 0.5613 | 6350 | 0.0001 | - |
316
+ | 0.5657 | 6400 | 0.0001 | - |
317
+ | 0.5701 | 6450 | 0.0 | - |
318
+ | 0.5746 | 6500 | 0.0 | - |
319
+ | 0.5790 | 6550 | 0.0 | - |
320
+ | 0.5834 | 6600 | 0.0 | - |
321
+ | 0.5878 | 6650 | 0.0 | - |
322
+ | 0.5922 | 6700 | 0.0 | - |
323
+ | 0.5967 | 6750 | 0.0 | - |
324
+ | 0.6011 | 6800 | 0.0 | - |
325
+ | 0.6055 | 6850 | 0.0 | - |
326
+ | 0.6099 | 6900 | 0.0 | - |
327
+ | 0.6143 | 6950 | 0.0 | - |
328
+ | 0.6188 | 7000 | 0.0 | - |
329
+ | 0.6232 | 7050 | 0.0 | - |
330
+ | 0.6276 | 7100 | 0.0 | - |
331
+ | 0.6320 | 7150 | 0.0 | - |
332
+ | 0.6364 | 7200 | 0.0 | - |
333
+ | 0.6409 | 7250 | 0.0 | - |
334
+ | 0.6453 | 7300 | 0.0 | - |
335
+ | 0.6497 | 7350 | 0.0 | - |
336
+ | 0.6541 | 7400 | 0.0 | - |
337
+ | 0.6585 | 7450 | 0.0 | - |
338
+ | 0.6630 | 7500 | 0.0 | - |
339
+ | 0.6674 | 7550 | 0.0 | - |
340
+ | 0.6718 | 7600 | 0.0 | - |
341
+ | 0.6762 | 7650 | 0.0 | - |
342
+ | 0.6806 | 7700 | 0.0 | - |
343
+ | 0.6851 | 7750 | 0.0 | - |
344
+ | 0.6895 | 7800 | 0.0 | - |
345
+ | 0.6939 | 7850 | 0.0 | - |
346
+ | 0.6983 | 7900 | 0.0 | - |
347
+ | 0.7027 | 7950 | 0.0 | - |
348
+ | 0.7072 | 8000 | 0.0 | - |
349
+ | 0.7116 | 8050 | 0.0 | - |
350
+ | 0.7160 | 8100 | 0.0 | - |
351
+ | 0.7204 | 8150 | 0.0 | - |
352
+ | 0.7248 | 8200 | 0.0 | - |
353
+ | 0.7292 | 8250 | 0.0 | - |
354
+ | 0.7337 | 8300 | 0.0 | - |
355
+ | 0.7381 | 8350 | 0.0 | - |
356
+ | 0.7425 | 8400 | 0.0 | - |
357
+ | 0.7469 | 8450 | 0.0001 | - |
358
+ | 0.7513 | 8500 | 0.0 | - |
359
+ | 0.7558 | 8550 | 0.0 | - |
360
+ | 0.7602 | 8600 | 0.0 | - |
361
+ | 0.7646 | 8650 | 0.0 | - |
362
+ | 0.7690 | 8700 | 0.0 | - |
363
+ | 0.7734 | 8750 | 0.0 | - |
364
+ | 0.7779 | 8800 | 0.0 | - |
365
+ | 0.7823 | 8850 | 0.0 | - |
366
+ | 0.7867 | 8900 | 0.0 | - |
367
+ | 0.7911 | 8950 | 0.0 | - |
368
+ | 0.7955 | 9000 | 0.0 | - |
369
+ | 0.8000 | 9050 | 0.0 | - |
370
+ | 0.8044 | 9100 | 0.0 | - |
371
+ | 0.8088 | 9150 | 0.0 | - |
372
+ | 0.8132 | 9200 | 0.0 | - |
373
+ | 0.8176 | 9250 | 0.0 | - |
374
+ | 0.8221 | 9300 | 0.0 | - |
375
+ | 0.8265 | 9350 | 0.0 | - |
376
+ | 0.8309 | 9400 | 0.0 | - |
377
+ | 0.8353 | 9450 | 0.0 | - |
378
+ | 0.8397 | 9500 | 0.0 | - |
379
+ | 0.8442 | 9550 | 0.0 | - |
380
+ | 0.8486 | 9600 | 0.0 | - |
381
+ | 0.8530 | 9650 | 0.0 | - |
382
+ | 0.8574 | 9700 | 0.0 | - |
383
+ | 0.8618 | 9750 | 0.0 | - |
384
+ | 0.8663 | 9800 | 0.0 | - |
385
+ | 0.8707 | 9850 | 0.0001 | - |
386
+ | 0.8751 | 9900 | 0.0 | - |
387
+ | 0.8795 | 9950 | 0.0 | - |
388
+ | 0.8839 | 10000 | 0.0 | - |
389
+ | 0.8884 | 10050 | 0.0 | - |
390
+ | 0.8928 | 10100 | 0.0 | - |
391
+ | 0.8972 | 10150 | 0.0 | - |
392
+ | 0.9016 | 10200 | 0.0 | - |
393
+ | 0.9060 | 10250 | 0.0 | - |
394
+ | 0.9105 | 10300 | 0.0 | - |
395
+ | 0.9149 | 10350 | 0.0 | - |
396
+ | 0.9193 | 10400 | 0.0 | - |
397
+ | 0.9237 | 10450 | 0.0 | - |
398
+ | 0.9281 | 10500 | 0.0 | - |
399
+ | 0.9326 | 10550 | 0.0 | - |
400
+ | 0.9370 | 10600 | 0.0 | - |
401
+ | 0.9414 | 10650 | 0.0 | - |
402
+ | 0.9458 | 10700 | 0.0 | - |
403
+ | 0.9502 | 10750 | 0.0 | - |
404
+ | 0.9547 | 10800 | 0.0 | - |
405
+ | 0.9591 | 10850 | 0.0 | - |
406
+ | 0.9635 | 10900 | 0.0 | - |
407
+ | 0.9679 | 10950 | 0.0 | - |
408
+ | 0.9723 | 11000 | 0.0 | - |
409
+ | 0.9768 | 11050 | 0.0 | - |
410
+ | 0.9812 | 11100 | 0.0 | - |
411
+ | 0.9856 | 11150 | 0.0 | - |
412
+ | 0.9900 | 11200 | 0.0 | - |
413
+ | 0.9944 | 11250 | 0.0 | - |
414
+ | 0.9989 | 11300 | 0.0 | - |
415
+
416
+ ### Framework Versions
417
+ - Python: 3.10.14
418
+ - SetFit: 1.0.3
419
+ - Sentence Transformers: 2.7.0
420
+ - Transformers: 4.40.1
421
+ - PyTorch: 2.2.0+cu121
422
+ - Datasets: 2.19.1
423
+ - Tokenizers: 0.19.1
424
+
425
+ ## Citation
426
+
427
+ ### BibTeX
428
+ ```bibtex
429
+ @article{https://doi.org/10.48550/arxiv.2209.11055,
430
+ doi = {10.48550/ARXIV.2209.11055},
431
+ url = {https://arxiv.org/abs/2209.11055},
432
+ author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
433
+ keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
434
+ title = {Efficient Few-Shot Learning Without Prompts},
435
+ publisher = {arXiv},
436
+ year = {2022},
437
+ copyright = {Creative Commons Attribution 4.0 International}
438
+ }
439
+ ```
440
+
441
+ <!--
442
+ ## Glossary
443
+
444
+ *Clearly define terms in order to be accessible across audiences.*
445
+ -->
446
+
447
+ <!--
448
+ ## Model Card Authors
449
+
450
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
451
+ -->
452
+
453
+ <!--
454
+ ## Model Card Contact
455
+
456
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
457
+ -->
config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "sentence-transformers/paraphrase-mpnet-base-v2",
3
+ "architectures": [
4
+ "MPNetModel"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 3072,
14
+ "layer_norm_eps": 1e-05,
15
+ "max_position_embeddings": 514,
16
+ "model_type": "mpnet",
17
+ "num_attention_heads": 12,
18
+ "num_hidden_layers": 12,
19
+ "pad_token_id": 1,
20
+ "relative_attention_num_buckets": 32,
21
+ "torch_dtype": "float32",
22
+ "transformers_version": "4.40.1",
23
+ "vocab_size": 30527
24
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "2.0.0",
4
+ "transformers": "4.7.0",
5
+ "pytorch": "1.9.0+cu102"
6
+ },
7
+ "prompts": {},
8
+ "default_prompt_name": null
9
+ }
config_setfit.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "normalize_embeddings": false,
3
+ "labels": null
4
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a12da7216ce2be119b97e25d91d8e8ce7f85c3fa6f9f19bfb3ed48504626759
3
+ size 437967672
model_head.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6df7c1434792c3e437a60334418cb5704cb5bfea07c573aec77ef0d94756c5a
3
+ size 6975
modules.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ }
14
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 512,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "[UNK]",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "104": {
28
+ "content": "[UNK]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "30526": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": true,
46
+ "cls_token": "<s>",
47
+ "do_basic_tokenize": true,
48
+ "do_lower_case": true,
49
+ "eos_token": "</s>",
50
+ "mask_token": "<mask>",
51
+ "model_max_length": 512,
52
+ "never_split": null,
53
+ "pad_token": "<pad>",
54
+ "sep_token": "</s>",
55
+ "strip_accents": null,
56
+ "tokenize_chinese_chars": true,
57
+ "tokenizer_class": "MPNetTokenizer",
58
+ "unk_token": "[UNK]"
59
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff