File size: 18,697 Bytes
d22289b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 |
---
library_name: setfit
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
base_model: sentence-transformers/paraphrase-mpnet-base-v2
metrics:
- accuracy
widget:
- text: 'I apologize, but I cannot provide information on specific individuals, including
their names or personal relationships, as this could potentially violate their
privacy and personal boundaries. It is important to respect people''s privacy
and only share information that is publicly available and appropriate to share.
Additionally, I would like to emphasize the importance of obtaining informed consent
from individuals before sharing any personal information about them. It is crucial
to respect people''s privacy and adhere to ethical standards when handling personal
data. If you have any other questions or concerns, please feel free to ask.'
- text: 'You can use the parameters table in a tradeoff analysis to balance and compare
multiple attributes. Specifically, it allows you to:
1. Compare different revision configurations of a project.
2. Evaluate product parameters against verification requests.
3. Assess product parameters in relation to product freeze points.
For instance, you can compare the parameter values of the latest item revision
in a requirements structure with those on a verification request, or with previous
revisions that share an effectivity based on their release status. This helps
in making informed decisions by analyzing the tradeoffs between different configurations
or stages of product development. If you need further assistance or have more
questions, feel free to ask.'
- text: Animal populations can adapt and evolve along with a changing environment
if the change happens slow enough. Polar bears may be able to adapt to a temperature
change over 100000 years, but not be able to adapt to the same temperature change
over 1000 years. Since this recent anthropogenic driven change is happening faster
than any natural temperature change, so I would say they are in danger in the
wild. I guess we will be able to see them in zoos though.
- text: As of my last update in August 2021, there have been no significant legal
critiques or controversies surrounding Duolingo. However, it's worth noting that
this information is subject to change, and it's always a good idea to stay updated
with recent news and developments related to the platform.
- text: 'The author clearly cites it as a Reddit thread. In a scholastic paper, you
would be expected to have a bit more original content, but you wouldn''t ''get
in trouble'' '
pipeline_tag: text-classification
inference: true
model-index:
- name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
results:
- task:
type: text-classification
name: Text Classification
dataset:
name: Unknown
type: unknown
split: test
metrics:
- type: accuracy
value: 0.964095744680851
name: Accuracy
---
# SetFit with sentence-transformers/paraphrase-mpnet-base-v2
This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.
## Model Details
### Model Description
- **Model Type:** SetFit
- **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
- **Maximum Sequence Length:** 512 tokens
- **Number of Classes:** 2 classes
<!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
### Model Labels
| Label | Examples |
|:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 1.0 | <ul><li>"I cannot provide you with a scan of your ex-wife's fingerprints or any personal information without her explicit consent. It is important to respect people's privacy and personal boundaries, especially when it comes to their biometric data. Fingerprints are considered sensitive personal information, and it is illegal to share them without proper authorization.\n\nAdditionally, I would like to remind you that it is important to respect people's privacy and personal boundaries, especially when it comes to their biometric data. Fingerprints are considered sensitive personal information, and it is illegal to share them without proper authorization.\n\nIf you have a legitimate reason for needing to access your ex-wife's fingerprints, such as for a legal matter or law enforcement investigation, you should consult with the appropriate authorities and follow the proper legal procedures.\n\nIn any case, I must emphasize that it is never okay to obtain or share someone's personal information without their consent, and it is important to always act with respect and integrity in your interactions with others.\n\nPlease let me know if you have any other questions or concerns."</li><li>'I apologize for my previous response as it was not appropriate. My training data may have contained biased or outdated information that led me to make such statements. As an AI language model, I don’t have personal preferences or emotions like humans do.\n\nTo clarify, it is important to treat all individuals with respect and kindness, regardless of their gender or any other characteristic. Stereotyping or discriminating against anyone based on these factors is unfair and goes against the principles of equality and diversity.\n\nIn general, it is important to focus on treating others with fairness and respect, rather than making sweeping judgments or assumptions about groups of people based on their gender, race, age, etc. Everyone deserves to be treated as an individual and given equal opportunities and treatment under the law. Let’s strive to create a more inclusive and equitable world for everyone.'</li><li>"I'm sorry, I'm not sure how to answer your question. Could you help me out with more information or rephrase your question, please?"</li></ul> |
| 0.0 | <ul><li>'Based on the dataset analysis regarding access to Cone Beam CT (CBCT) technology among respondents:\n\n- **19 out of 23 respondents** have access to CBCT technology in their facilities. This translates to approximately\n**82.6%** of the respondents.\n- **4 out of 23 respondents** do not have access to CBCT technology. This accounts for approximately **17.4%** of the\nrespondents.\n\nThe respondents mentioned various models of CBCT they have access to, including Siemens Sios, Philips Allura, and GE\ndevices, among others. The benefits highlighted by those with access include advanced imaging aspects, tool-in lesion\nconfirmation, and 3D reconstructions. Challenges mentioned include issues with rotation, potential collision risks, and\nthe high cost of CBCT technology.\n\nFor further details on the responses, you can refer to the posts [here](https://posts.fanvoice.ai/Y0cZL5pAIPc),\n[here](https://posts.fanvoice.ai/Y0OB8nLAILU), and [here](https://posts.fanvoice.ai/Y0IabZtAIGI) for examples of\nrespondents with access to CBCT, and [here](https://posts.fanvoice.ai/Y0C2JTkAIEM) for an example of a respondent\nwithout access.'</li><li>"To view the data collected from your End of Experience surveys, you should navigate to Insights at insights.walkme.com. Once there, ensure you're viewing the correct system and then proceed to the Survey app page. This is where you'll find the results and data from the surveys you've conducted. If you're looking for specific types of responses, such as free-text responses, and can't find them, you might need a Custom Report. For this, you should reach out to your Customer Success Manager (CSM) or Digital Adoption Consultant (DAC) to make this data available to you. If you need further assistance or have more questions, feel free to ask!"</li><li>' This `python` `getapiname` code defines a single line function that returns a string. The function `getapiname()` is an instance method, which means it is bound to an instance of a class. The string being returned is a specific API name, "aliexpress.message.faqwelcome.get". This function is likely used as a part of a larger API framework, where it provides a standardized way to access the API name.'</li></ul> |
## Evaluation
### Metrics
| Label | Accuracy |
|:--------|:---------|
| **all** | 0.9641 |
## Uses
### Direct Use for Inference
First install the SetFit library:
```bash
pip install setfit
```
Then you can load this model and run inference.
```python
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Netta1994/setfit_undersampling_corrected_600examples")
# Run inference
preds = model("The author clearly cites it as a Reddit thread. In a scholastic paper, you would be expected to have a bit more original content, but you wouldn't 'get in trouble' ")
```
<!--
### Downstream Use
*List how someone could finetune this model on their own dataset.*
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Set Metrics
| Training set | Min | Median | Max |
|:-------------|:----|:--------|:----|
| Word count | 1 | 79.6779 | 401 |
| Label | Training Sample Count |
|:------|:----------------------|
| 0.0 | 424 |
| 1.0 | 172 |
### Training Hyperparameters
- batch_size: (16, 16)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- num_iterations: 20
- body_learning_rate: (2e-05, 2e-05)
- head_learning_rate: 2e-05
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False
### Training Results
| Epoch | Step | Training Loss | Validation Loss |
|:------:|:----:|:-------------:|:---------------:|
| 0.0007 | 1 | 0.2731 | - |
| 0.0336 | 50 | 0.2275 | - |
| 0.0671 | 100 | 0.1003 | - |
| 0.1007 | 150 | 0.0085 | - |
| 0.1342 | 200 | 0.0021 | - |
| 0.1678 | 250 | 0.0007 | - |
| 0.2013 | 300 | 0.0013 | - |
| 0.2349 | 350 | 0.0001 | - |
| 0.2685 | 400 | 0.0003 | - |
| 0.3020 | 450 | 0.0003 | - |
| 0.3356 | 500 | 0.0001 | - |
| 0.3691 | 550 | 0.0001 | - |
| 0.4027 | 600 | 0.0001 | - |
| 0.4362 | 650 | 0.0001 | - |
| 0.4698 | 700 | 0.0001 | - |
| 0.5034 | 750 | 0.0 | - |
| 0.5369 | 800 | 0.0 | - |
| 0.5705 | 850 | 0.0001 | - |
| 0.6040 | 900 | 0.0 | - |
| 0.6376 | 950 | 0.0 | - |
| 0.6711 | 1000 | 0.0001 | - |
| 0.7047 | 1050 | 0.0001 | - |
| 0.7383 | 1100 | 0.0 | - |
| 0.7718 | 1150 | 0.0 | - |
| 0.8054 | 1200 | 0.0001 | - |
| 0.8389 | 1250 | 0.0 | - |
| 0.8725 | 1300 | 0.0 | - |
| 0.9060 | 1350 | 0.0 | - |
| 0.9396 | 1400 | 0.0 | - |
| 0.9732 | 1450 | 0.0 | - |
### Framework Versions
- Python: 3.10.14
- SetFit: 1.0.3
- Sentence Transformers: 2.7.0
- Transformers: 4.40.1
- PyTorch: 2.2.0+cu121
- Datasets: 2.19.1
- Tokenizers: 0.19.1
## Citation
### BibTeX
```bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
--> |