metadata

base_model: sentence-transformers/all-mpnet-base-v2
library_name: setfit
metrics:
  - accuracy
pipeline_tag: text-classification
tags:
  - setfit
  - sentence-transformers
  - text-classification
  - generated_from_setfit_trainer
widget:
  - text: >
      I have alcoholism, drug abouse and suicide all over my family as far back
      as three generations. After seeing several friend in college (class of
      '76, U of Arkansas, Go Hogs!) get blind drunk and  raped at frat parties,
      I decided I could live without it. And I have -- even through five years
      active duty in the army. I cook with wine and my husband likes a daily
      beer in the summer. I haven't missed a thing, I'm height-weight
      proportionate and probably a few pesos richer for not having squandered
      money on booze. I live outside the US and I've seen dozens of women
      battered beyond recognition by drunk husbands, children neglected by their
      parents almost to a point of starvation, and families ruptured and ruined
      by alcohol. It ain't worth it.
  - text: >
      The War Between the Catholic Cardinals Two essays make plain the different
      views often obscured by careful political maneuvering within the church.
      The death of the pope emeritus, Benedict XVI, was succeeded by a small
      literary outpouring, a rush of publications that were interpreted as
      salvos in the Catholic Church’s civil war. The list includes a memoir by
      Benedict’s longtime secretary that mentioned the former pontiff’s
      disappointment at his successor’s restriction of the Latin Mass, a
      posthumous essay collection by Benedict himself that’s being mined for
      controversial quotes, and an Associated Press interview with Pope Francis
      that made news for its call to decriminalize homosexuality around the
      world. Two essays make plain the different views often obscured by careful
      political maneuvering within the church.
  - text: >
      "As one of the 100,000 or so Catholics in this country who attend the old
      Mass each week, I will always be grateful to him for allowing for its
      widespread celebration despite the promulgation of a new, vernacular
      liturgy."This really says it all. "Soren Kierkegaard?"? Really? Mr.
      Walther may be the editor of "The Lamp," but his lamp sheds no light on
      Ratzinger or the fundamental evils of the continuous and painfully slow
      downward spiral that has been the trajectory of the papacy and the Roman
      Catholic Church for a very long time.Vatican II opened up a great hope.
      Ratzinger and his followers saw in it only a threat to the cult of
      secrecy, both of the sacraments, and the sins. They have done much to
      unravel the all of the inherent good of Vatican II -- which actually made
      Catholicism interesting and meaningful to youths at a time of great
      cynicism in the world. Walther and his 100,000 should form their own 4th
      century Catholic schism, "despite the promulgation of a new, vernacular
      liturgy," and leave what's left of the Catholic church alone to re-build.
  - text: >
      Benedict, the reluctant popeThe former Cardinal Ratzinger had never wanted
      to be pope, planning at age 78 to spend his final years writing in the
      “peace and quiet” of his native Bavaria.Instead, he was forced to follow
      the footsteps of the beloved St. John Paul II and run the church through
      the fallout of the clerical sex abuse scandal Being elected pope, he once
      said, felt like a “guillotine” had come down on him. Nevertheless, he set
      about the job with a single-minded vision to rekindle the faith in a world
      that, he frequently lamented, seemed to think it could do without God.“In
      vast areas of the world today, there is a strange forgetfulness of God,”
      he told one million young people gathered on a vast field for his first
      foreign trip as pope, to World Youth Day in Cologne, Germany, in 2005. “It
      seems as if everything would be just the same even without him.”With some
      decisive, .. he tried to remind Europe of its Christian heritage. And he
      set the Catholic Church on a conservative, tradition-minded path that
      often alienated progressives. He relaxed the restrictions on celebrating
      the old Latin Mass. It was a path that in many ways was reversed by his
      successor, Francis, whose mercy-over-morals priorities alienated the
      traditionalists Benedict’s style couldn’t have been more different from
      that of Francis. No globe-trotting media darling or populist, Benedict was
      a teacher, theologian and academic to the core: quiet and pensive with a
      fierce mind. El Pais Dec
  - text: >
      Willy Stone  Wouldn't it be a pity if all ancient art could only be seen
      in the location where it was made?
inference: true
model-index:
  - name: SetFit with sentence-transformers/all-mpnet-base-v2
    results:
      - task:
          type: text-classification
          name: Text Classification
        dataset:
          name: Unknown
          type: unknown
          split: test
        metrics:
          - type: accuracy
            value: 1
            name: Accuracy

SetFit with sentence-transformers/all-mpnet-base-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/all-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

Fine-tuning a Sentence Transformer with contrastive learning.
Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Type: SetFit
Sentence Transformer body: sentence-transformers/all-mpnet-base-v2
Classification head: a LogisticRegression instance
Maximum Sequence Length: 384 tokens
Number of Classes: 2 classes

Model Sources

Repository: SetFit on GitHub
Paper: Efficient Few-Shot Learning Without Prompts
Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
yes	'The First Afterlife of Pope Benedict XVI Pope Benedict’s legacy will be felt across decades or even centuries. The first pope to resign was Celestine V, born Pietro Da Morrone, who was living the life of a pious hermit when he was elevated to the papacy in 1294, in his 80s, to break a two-year deadlock in the College of Cardinals. Feeling overmastered by the job, he soon resigned in the expectation that he could return to his monastic existence. Instead, he was imprisoned by his successor, Boniface VIII, who feared that some rival faction might make Celestine an antipope. Pope Benedict’s legacy will be felt across decades or even centuries.\n' 'Here is the statement on Ratzinger's death from SNAP, an organization representing victims of abuse from the Catholic Church: "In our view, the death of Pope Benedict XVI is a reminder that, much like John Paul II, Benedict was more concerned about the church’s deteriorating image and financial flow to the hierarchy versus grasping the concept of true apologies followed by true amends to victims of abuse. The rot of clergy sexual abuse of children and adults, even their own professed religious, runs throughout the Catholic church, to every country, and we now have incontrovertible evidence, all the way to the top.Any celebration that marks the life of abuse enablers like Benedict must end. It is past time for the Vatican to refocus on change: tell the truth about known abusive clergy, protect children and adults, and allow justice to those who have been hurt. Honoring Pope Benedict XVI now is not only wrong. It is shameful.It is almost a year after a report into decades of abuse allegations by a law firm in Germany has shown that Pope Benedict XVI did not take action against abusive priests in four child abuse cases while he was Archbishop (Josef Ratzinger). In our view, Pope Benedict XVI is taking decades of the church’s darkest secrets to his grave with him..."https://www.snapnetwork.org/snap_reacts_to_the_death_of_pope_benedict_xvi\n' 'I found the statement "While Benedict felt that celebrations of the new Mass were frequently unedifying and even banal..." to be flawed when compared to the post-Vatican II church in the USA. Where was Benedict when Catholic churches in the US held "folk masses" using guitars and keyboard instruments instead of organs? My confirmation ceremony in 1970 in NJ was held that way and one I remember clearly to this very day.If Benedict was really looking for the "cosmic" dimension of the liturgy, maybe he should have attended Maronite Catholic Masses on a regular basis. At the very least, he would have observed the Maronites' liturgical rituals which date back into the First Century A.D., not to mention the use of Aramaic, the language of Christ, during the consecration of the Eucharist.\n'
no	'I’m not a Rogan fan, but this is just a few adventurers adventuring. As long as they are experienced divers with the proper equipment and aware of the dangers, who knows what they might find at the bottom of the East River? Inquiring minds want to know.\n' 'Mike DiNovi One thing we can agree on is that, depending on our individual backgrounds, there are for each of us, a whole treasure trove of "missing" words. Often but not always, these words may be found in the crosswords, particularly older crosswords. But to ask for all of them to be included here would be asking to change the whole gestalt, as well as immodest. But I think longtime players of the Bee still see some value and delight in posting missing words. It may not be included in the official list but the Hive gives them currency. I personally enjoy all the "missing" word posts, however redundant they often are. I find in them some commonality and I have learned also probably several dozen new words - unofficial and official - including many chemistry words. I was a lousy chemistry student but I absolutely love the vocabulary of it.\n' 'If "work on what comes next" and "innovation" means expanding the definition of "life" to mean all stages of life from womb to tomb (e.g., paternal leave, pre-school, school choice, basic universal healthcare, baby bonds, etc.) that would be a positive and hopefully inclusive step forward that might bridge the awful divide we see across the country and even in the comments of this article.\n'

Label

Examples

yes

'The First Afterlife of Pope Benedict XVI Pope Benedict’s legacy will be felt across decades or even centuries. The first pope to resign was Celestine V, born Pietro Da Morrone, who was living the life of a pious hermit when he was elevated to the papacy in 1294, in his 80s, to break a two-year deadlock in the College of Cardinals. Feeling overmastered by the job, he soon resigned in the expectation that he could return to his monastic existence. Instead, he was imprisoned by his successor, Boniface VIII, who feared that some rival faction might make Celestine an antipope. Pope Benedict’s legacy will be felt across decades or even centuries.\n'
'Here is the statement on Ratzinger's death from SNAP, an organization representing victims of abuse from the Catholic Church: "In our view, the death of Pope Benedict XVI is a reminder that, much like John Paul II, Benedict was more concerned about the church’s deteriorating image and financial flow to the hierarchy versus grasping the concept of true apologies followed by true amends to victims of abuse. The rot of clergy sexual abuse of children and adults, even their own professed religious, runs throughout the Catholic church, to every country, and we now have incontrovertible evidence, all the way to the top.Any celebration that marks the life of abuse enablers like Benedict must end. It is past time for the Vatican to refocus on change: tell the truth about known abusive clergy, protect children and adults, and allow justice to those who have been hurt. Honoring Pope Benedict XVI now is not only wrong. It is shameful.It is almost a year after a report into decades of abuse allegations by a law firm in Germany has shown that Pope Benedict XVI did not take action against abusive priests in four child abuse cases while he was Archbishop (Josef Ratzinger). In our view, Pope Benedict XVI is taking decades of the church’s darkest secrets to his grave with him..."https://www.snapnetwork.org/snap_reacts_to_the_death_of_pope_benedict_xvi\n'
'I found the statement "While Benedict felt that celebrations of the new Mass were frequently unedifying and even banal..." to be flawed when compared to the post-Vatican II church in the USA. Where was Benedict when Catholic churches in the US held "folk masses" using guitars and keyboard instruments instead of organs? My confirmation ceremony in 1970 in NJ was held that way and one I remember clearly to this very day.If Benedict was really looking for the "cosmic" dimension of the liturgy, maybe he should have attended Maronite Catholic Masses on a regular basis. At the very least, he would have observed the Maronites' liturgical rituals which date back into the First Century A.D., not to mention the use of Aramaic, the language of Christ, during the consecration of the Eucharist.\n'

'I’m not a Rogan fan, but this is just a few adventurers adventuring. As long as they are experienced divers with the proper equipment and aware of the dangers, who knows what they might find at the bottom of the East River? Inquiring minds want to know.\n'
'Mike DiNovi One thing we can agree on is that, depending on our individual backgrounds, there are for each of us, a whole treasure trove of "missing" words. Often but not always, these words may be found in the crosswords, particularly older crosswords. But to ask for all of them to be included here would be asking to change the whole gestalt, as well as immodest. But I think longtime players of the Bee still see some value and delight in posting missing words. It may not be included in the official list but the Hive gives them currency. I personally enjoy all the "missing" word posts, however redundant they often are. I find in them some commonality and I have learned also probably several dozen new words - unofficial and official - including many chemistry words. I was a lousy chemistry student but I absolutely love the vocabulary of it.\n'
'If "work on what comes next" and "innovation" means expanding the definition of "life" to mean all stages of life from womb to tomb (e.g., paternal leave, pre-school, school choice, basic universal healthcare, baby bonds, etc.) that would be a positive and hopefully inclusive step forward that might bridge the awful divide we see across the country and even in the comments of this article.\n'

Evaluation

Metrics

Label	Accuracy
all	1.0

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("davidadamczyk/setfit-model-10")
# Run inference
preds = model("Willy Stone  Wouldn't it be a pity if all ancient art could only be seen in the location where it was made?
")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	15	123.625	286

Label	Training Sample Count
no	18
yes	22

Training Hyperparameters

batch_size: (16, 16)
num_epochs: (1, 1)
max_steps: -1
sampling_strategy: oversampling
num_iterations: 120
body_learning_rate: (2e-05, 2e-05)
head_learning_rate: 2e-05
loss: CosineSimilarityLoss
distance_metric: cosine_distance
margin: 0.25
end_to_end: False
use_amp: False
warmup_proportion: 0.1
l2_weight: 0.01
seed: 42
eval_max_steps: -1
load_best_model_at_end: False

Training Results

Epoch	Step	Training Loss	Validation Loss
0.0017	1	0.365	-
0.0833	50	0.1213	-
0.1667	100	0.0018	-
0.25	150	0.0004	-
0.3333	200	0.0002	-
0.4167	250	0.0002	-
0.5	300	0.0001	-
0.5833	350	0.0001	-
0.6667	400	0.0001	-
0.75	450	0.0001	-
0.8333	500	0.0001	-
0.9167	550	0.0001	-
1.0	600	0.0001	-

Framework Versions

Python: 3.10.13
SetFit: 1.1.0
Sentence Transformers: 3.0.1
Transformers: 4.45.2
PyTorch: 2.4.0+cu124
Datasets: 2.21.0
Tokenizers: 0.20.0

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}