File size: 30,793 Bytes
1347b6a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 |
---
language: en
license: apache-2.0
library_name: setfit
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
base_model: sentence-transformers/paraphrase-mpnet-base-v2
metrics:
- accuracy
- precision
- recall
- f1
widget:
- text: a cinematic masterpiece.. i can't believe my eyes what just i experienced
in theatre, this movie is one of the best cinematic experience i've ever had..
from opening scene to end credit every second is worth it.. epic score by hans
zimmer elevates the experience, filled with beautiful shots and cinematography
to a great scrrenplay and some top notch acting by every cast member dune 2 will
be remembered as one of the best films of this generation even after 50 years
later that's my guarantee.. denis villeneuve is one of the best director of this
generation who gave us masterpiece like blade runner 2049 and currently working
on 3rd part of this trilogy which i can't wait to see.. action scenes were great
featuring big ships, blasters laser guns and every other kind of weapons, sound
effects were amazing but most importantly screenplay was well paced and story
featuring blend of sci fi and fantasy elements is absolute best of the best even
though it is an adaptation of 1965 novel of same name it is one of the best adaptations
ever.. i loved both movies and can't wait to see what happens in future because
i enjoy films about the chosen one prophecy like star wars, the matrix and now
this.. i won't give any spoiler here and will not talk about anything shown in
the movie since you need to see this movie for yourself to feel the magic.. don't
miss it at any cost.. watch it on the biggest screen possible especially imax
to enjoy epic sound effects and see the larger than life picture you'll love it..
- text: hopeful for the future of this franchise this one's very personal for me since
i've been invested in this franchise for years now and all the waiting throughout
the production of both parts, considering the multiple delays, have been worthwhile
and it only enriched the experience, so it's really hard for me to not sound like
an absolute fanboy.every tidbit of news from the start of the production only
fueled my excitement, from cast and crew announcements to first look reveals to
teasers and trailers which i probably watched and obsessively dissected dozens
of times. which always put at rest my lore obsessed brain because it all made
sense, i could tell from the beginning that both parts were crafted by people
who understood and cared about the source material without approaching it like
some sort of sacred text. on that note i was quite surprised and pleased by the
changes they did with characters, timeline and most specifically the ending, which
only left me wanting more.despite the fact that unfortunately my local cinema
doesn't have imax screens the experience was an absolute blast and i was nothing
short of euphoric with a stupid grin the entire movie it felt surreal and overwhelming
at times taking it all in. i loved how it expanded from the themes established
in the first one, particularly the detailed exploration of fremen culture, how
ominous and mysterious felt the bene gesserit, as for the harkonnens besides the
obvious praise for how brutal, weird and cool they're portrayed i particularly
appreciated the h. r giger inspired look of their black sun lit giedi prime. all
while staying true to the essence of the story.with a chunky and lengthy runtime
its impossible for me to pinpoint favorite moments. my jaw dropped at the sheer
scale of many sequences, namely the opening scene with the orange hues and the
levitating harkonnens, also the gladiator scene, the big feyd-rautha entrance
was bonkers the fighting choreography felt natural and realistic and well thought
out, tho i gotta admit i was iffy at first but ultimately pleasantly surprised
by austin's feyd-rautha.overall, the performances, direction, music, sound design,
cinematography, and production design were outstanding. the themes of fanaticism
and the difficulty of reasoning with true believers resonated deeply with me.
plus, getting to watch it with three of my favorite people made the movie watching
experience even more lovely. dune part two exceeded my every expectations and
left me eagerly awaiting the next installment. i can confidently say that this
is the perfect dune adaptation.
- text: disappointing like seriously... what the hell was that? :-( first part was
mostly on point... but the second part?? why alter perfection?it totally missed
in my opinion. the nukes were used for the shields, not for the spice. the water
of life was meant to be used for the spice... the great houses came together with
the emperor, why was this changed? where is the baby? where is the sister? why
was the guild cut out all together? where is the scene between. gurney and lady
jessica. all this gave context to the story what now went totally missing.as it
was cut together now, the only thing truly great about the movie was the sound
editing. this gave a great atmosphere. i in general like villeneuve alot, sicario
is one of the top3 the greatest movies ever made, but this was disappointing.
- text: dune 1 & 2 are probably the best sci-fi movies ever... yes, dune 1 & 2 are
probably the best sci-fi movies ever. i can't really come up with anything else
that would beat these anyway.part two was a nice continuation to part one, however
i felt the last part of the movie could have been better or maybe it just went
too fast. without spoiling its hard to explain. also missed some more insight
about the mother and a lot of other things as well... imagine if this could have
been a 20 episode serie with same quality!anyhow visually and the main cast were
just excellent. i did expect more out of the emperor christofer walken.just love
the tonality of the entire movie and the sound and music made it masterful.please
more of these "adult" epic sci-fi movies and series!
- text: great movie with holes in the plot dune 2 is a great movie that can be enjoyed
despite some holes in the plot and questionable story elements. the movie is great
visually and serves as an example of how cgi doesn't have to make a movie seem
sterile and fake, or like watching a video game like the new brand of marvel movies
and aquaman do.the cast is great - christopher walken should have had more scenes
and other than it being him, his performance was not unique in any way - and there
is a non credited appearance that i'm not going to spoil that is a wow!the movie
is long, but there's a difference between long and too long, and any movie that
wants to be an epic. 2 out of 5 found this helpful. was this review helpful? sign
in to vote. permalink
pipeline_tag: text-classification
inference: true
model-index:
- name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2 on data/raw/15239678.jsonl
results:
- task:
type: text-classification
name: Text Classification
dataset:
name: data/raw/15239678.jsonl
type: unknown
split: test
metrics:
- type: accuracy
value: 0.8246753246753247
name: Accuracy
- type: precision
value: 0.9915611814345991
name: Precision
- type: recall
value: 0.818815331010453
name: Recall
- type: f1
value: 0.8969465648854962
name: F1
---
# SetFit with sentence-transformers/paraphrase-mpnet-base-v2 on data/raw/15239678.jsonl
This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.
## Model Details
### Model Description
- **Model Type:** SetFit
- **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
- **Maximum Sequence Length:** 512 tokens
- **Number of Classes:** 2 classes
<!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
- **Language:** en
- **License:** apache-2.0
### Model Sources
- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
### Model Labels
| Label | Examples |
|:---------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| negative | <ul><li>"it's like watching a cult and not really a good movie. sorry not for me. all the characters gave justice on their roles, well executed. the pace of the story is so slow that it made me so sleepy in the middle of the film. actually the film made me bored coz i expected more but a lousy story. i would like to mention rebecca ferguson, she's a great actress and really fit to be the lady jessica itself. in the middle of the film, me and three of my friends wanted to go home coz it feels like we're watching a cult movie. not a good one for children's to watch. in this movie, nothing much to expect, such a waste of time and it was a very boring film fighting for a spice. 19 out of 100 found this helpful. was this review helpful? sign in to vote. permalink"</li><li>'the avengers-era "cinema" for a call of duty generation i watched dune: part two on imax (as seems befitting that sort of big-budget picture), in pretty good seats considering the house was packed with a diverse crowd of young adults for the late-night showing.my review of the first of denis villeneuve\'s adaptations was that it was pretty to look at, but basically uninteresting in its plot, a major let-down considering how hyped the books have been, when on the screen they\'re no better than star wars. this second one exhibits those same features, but worse.this is basically an action movie--a genre which i\'m fundamentally uninterested in--which seems at odds with all the talk of dune being characterized by complex political & economic maneuvering--of which this film does include some, albeit parenthetically. the scenes are impressionistic in their pacing and content, and expressionistic in that the photography & score are more about attempting to convey emotionality, or at least get the adrenaline pumping, than any sort of profound characterizations or themes. this is lawrence of arabia in space but with the cold war as the contemporary allegory. that sort of story would still have been resonant during the post-9/11 era, but we\'ve moved on from those wars by now into an altogether different geopolitics and political economy.the monumentalism of the shots can be impressive, and certainly the design of the mechanical vehicles is (in addition to the still-eye candy costumes), but there are too many moments where it\'s like watching a video game cut-scene, or even a video game playing out (c.f. the entire opening sequence). cinema is going backwards when that\'s the case. and there are some egregious dissonances in the sound design, most of all in the various accents the actors were allowed to use, which takes us out of the suspension of disbelief, but also in the over-application of non-diegetic score, which treats the audience as dumb emotions-receptacles, during scenes that by-and-large do not earn such responses.(the only outstanding sequence of the film is when paul attempts his first worm-ride, which is almost as exhilirating as the roller coaster ride it attempts to be for us on screen.)there are also weird dissonances in this film attempting to be humorous, as the on-again off-again nature of those lines (and how they\'re delivered) feel like a wink to the audience that this allegory of abrahamic religions co-opting a people\'s revolution--albeit against a totalitarian capitalist empire, mixing all kinds of economic stages of history, much as the genres of swords & planets and sci-fi and fantasy are mixed--is not to be taken too seriously in our secular times. but then, what are we to take from this "epic"?'</li><li>"try as hard as you like i left feeling bored, and that's a bad sign for an epic sci-fi. i watched dune i and loved it, the deep sonorous sounds of an alien nation were exciting, and the dialogue kept minimal and thick. dune ii blasts you with ott noise, over the top effects, and piss poor dialogue... 'for the duke, and my friends' i felt this movie was aimed at a pre-teen audience with spiderman fetish and a heavy hand of americanism... the emperor was not an emperor. recommend putting a human written storyline first and leave ai/cgi to a bare minimum. i watched dune 20 years ago and loved it. i read dune 30 years ago and loved it. the actors tried hard with what they got but it wasn't enough to make it a masterpiece, it's more like an aprenticepiece."</li></ul> |
| positive | <ul><li>"best movie in recent years. the movie is a more impressive, more exciting and deeper production than the first part. give it 9 out of 10.the acting, visual effects, music and atmosphere in the movie are amazing. paul's evolution is perfectly demonstrated by timothee chalamet.the visual effects deliver a breathtaking rendering of arrakis' desert landscapes, giant worms, and battle scenes. you can smell the scent of a spice behind curtain.music adds soul to the film with the mastery of hans zimmer. the atmosphere is to keep tension and emotion at a high level throughout the film.while the film's script remains faithful to the book, it also offers some differences. while some changes make the film better, others do not fit the spirit of the book. however, i can honestly say that the changes made do not harm the film at all.dune: part two is one of the masterpieces of science fiction cinema. it's the best movie i've seen in nearly 15 years. maybe oppenheimer.nah, this movie is better."</li><li>"best movie ever what a movie!!!!!!!!!!the whole movie is so good! the setting is amazing. the story is so good. and the plot and the premise is amazing my favorite characters are paul and chani. this whole movie is seeking revenge from the darkness and the evil that was causing the world to collapse. and following that they decide just like on star wars to choose what side they're on the light side or the dark side. and man the cliffhanger of the movie was the most shocking thing ever. the whole movie is a very well done movie. i love this movie so much it gave me chills. this movie will get the best picture next year for the oscars. 0 out of 0 found this helpful. was this review helpful? sign in to vote. permalink"</li><li>"very spicey! undoubtedly one of the greatest cinematic experiences i've ever had. most movies nowadays try to wow you with either visuals, action, character development, and seemingly less and less so everyday with a reasonable plot. this movie manages to check off every box. it is hard to pinpoint an actor in it that wasn't superb in their role. the visual effects, especially in imax , are stunning and are not simply artistic in nature, but actually work to advance the plot.the film is pieced together so brilliantly with each act seamlessly fitting in with the last. the score by zimmer is unsurprisingly absolute perfection as well.for the length of the movie it actually feels quite short which is a huge achievement and shows how immersed you become in villneuve's world.however, i would have liked to see more of feyd rautha. they had an epic scene of his in the harkonnen arena, but not too much else to develop him for his final battle against paul. i also would have liked to see the sardaukar put up a little better of a fight. they somehow went from the empires greatest fighters to pretty pathetic. perhaps this was to show how strong paul and his forces had become, but it just seemed a bit too easy. still these are just personal aspects i would have liked to see and are not issues in the movie itself.overall, an epic movie, and the trilogy is likely to be sitting right alongside the lord of the rings and the original star wars movies when all is said and done.this is a can't miss in imax."</li></ul> |
## Evaluation
### Metrics
| Label | Accuracy | Precision | Recall | F1 |
|:--------|:---------|:----------|:-------|:-------|
| **all** | 0.8247 | 0.9916 | 0.8188 | 0.8969 |
## Uses
### Direct Use for Inference
First install the SetFit library:
```bash
pip install setfit
```
Then you can load this model and run inference.
```python
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("carlesoctav/SentimentClassifierDune-8shot")
# Run inference
preds = model("great movie with holes in the plot dune 2 is a great movie that can be enjoyed despite some holes in the plot and questionable story elements. the movie is great visually and serves as an example of how cgi doesn't have to make a movie seem sterile and fake, or like watching a video game like the new brand of marvel movies and aquaman do.the cast is great - christopher walken should have had more scenes and other than it being him, his performance was not unique in any way - and there is a non credited appearance that i'm not going to spoil that is a wow!the movie is long, but there's a difference between long and too long, and any movie that wants to be an epic. 2 out of 5 found this helpful. was this review helpful? sign in to vote. permalink")
```
<!--
### Downstream Use
*List how someone could finetune this model on their own dataset.*
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Set Metrics
| Training set | Min | Median | Max |
|:-------------|:----|:-------|:----|
| Word count | 121 | 271.5 | 993 |
| Label | Training Sample Count |
|:---------|:----------------------|
| negative | 8 |
| positive | 8 |
### Training Hyperparameters
- batch_size: (16, 16)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- body_learning_rate: (2e-05, 1e-05)
- head_learning_rate: 0.01
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: True
### Training Results
| Epoch | Step | Training Loss | Validation Loss |
|:-------:|:-----:|:-------------:|:---------------:|
| 0.1111 | 1 | 0.2058 | - |
| **1.0** | **9** | **-** | **0.2368** |
* The bold row denotes the saved checkpoint.
### Framework Versions
- Python: 3.10.11
- SetFit: 1.0.3
- Sentence Transformers: 2.5.1
- Transformers: 4.38.2
- PyTorch: 2.0.1
- Datasets: 2.18.0
- Tokenizers: 0.15.2
## Citation
### BibTeX
```bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
--> |