Hugging Face's logo

Omar-Nasr
/
setfitmodel

Text Classification
setfit
Safetensors
sentence-transformers
roberta
generated_from_setfit_trainer
Eval Results
Model card Files Community
Omar-Nasr commited on
Commit
16a092a
•
1 Parent(s): 119bbbe

Add SetFit model

Browse files
Files changed (3) hide show
  1. README.md +37 -42
  2. model.safetensors +1 -1
  3. model_head.pkl +2 -2
README.md CHANGED
@@ -9,19 +9,26 @@ base_model: Omar-Nasr/setfitmodel
9
  metrics:
10
  - accuracy
11
  widget:
12
- - text: ' Like jumping into a pool, or starting an assignment'
13
- - text: ' That''s kind of the nature of my volunteer work, but you could volunteer
14
- with a food bank or boys and girls club, which would involve more social interaction
15
- Just breaking that cycle by going for a short walk around the neighbourhood is
16
- a good idea'
17
- - text: ' And you will have the confidence inside of you, so you wont have to worry
18
- about the outside so much'
19
- - text: ' Do your make up then, get out of that hotel room and take your notes with
20
- you! Go for a walk, try to focus on your senses (the smells, the sounds, the winds
21
- and the temperature, possible the sun burning your skin)'
22
- - text: I would disagree as I usually read people well and could see that he was not
23
- comfortable talking with me, in the first lunch break he left after 5 minutes
24
- and said he wanted to take a walk around the building
 
 
 
 
 
 
 
25
  pipeline_tag: text-classification
26
  inference: true
27
  model-index:
@@ -36,7 +43,7 @@ model-index:
36
  split: test
37
  metrics:
38
  - type: accuracy
39
- value: 0.4666666666666667
40
  name: Accuracy
41
  ---
42
 
@@ -68,19 +75,19 @@ The model has been trained using an efficient few-shot learning technique that i
68
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
69
 
70
  ### Model Labels
71
- | Label | Examples |
72
- |:------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
73
- | 1.0 | <ul><li>' Go out for a walk once a day additionally and slowly start increasing the time you spend outside Go out for a walk once a day additionally and slowly start increasing the time you spend outside Start doing sport, either outdoors or at a gym If you can, try to take your dog to a dog park or something like that'</li><li>" Now I'm not saying to go to a party on the spot, just go out, shop, take a walk in the park, that kind of thing Now I'm not saying to go to a party on the spot, just go out, shop, take a walk in the park, that kind of thing"</li><li>' antidepressants, therapy, meditation, walking in nature (these work for me idk about other people) antidepressants, therapy, meditation, walking in nature (these work for me idk about other people) '</li></ul> |
74
- | 2.0 | <ul><li>'Try playing soccer haha'</li><li>" I didn't go outside too much"</li><li>" But we can't sleep in a hotel, we have go camping"</li></ul> |
75
- | 3.0 | <ul><li>" I don't know anyone in the city, I don't think I have enough courage to go outside alone"</li><li>" But even then, I didn't have any other problems outside school I still had no friends at European school, I haven't had any walks which I had constantly with my friends back in Ukraine"</li><li>" For the past two months I've been doing my usual; not going outside just watching South Park and only going out when someone drags me For the past two months I've been doing my usual; not going outside just watching South Park and only going out when someone drags me"</li></ul> |
76
- | 0.0 | <ul><li>' I would do this too but then I run the risk of meeting someone I know lol'</li><li>" Does it matter you are alone? NO Does it matter you can't run the full marathon at top speed? NO Are you useless? NO Seriously nobody is going to pay attention to you and think you are a lonely loser"</li><li>' If anything you should be thinking about wearing sun screen so you retain your good skin as it becomes your ally as you age outside'</li></ul> |
77
 
78
  ## Evaluation
79
 
80
  ### Metrics
81
  | Label | Accuracy |
82
  |:--------|:---------|
83
- | **all** | 0.4667 |
84
 
85
  ## Uses
86
 
@@ -100,7 +107,7 @@ from setfit import SetFitModel
100
  # Download from the 🤗 Hub
101
  model = SetFitModel.from_pretrained("Omar-Nasr/setfitmodel")
102
  # Run inference
103
- preds = model(" Like jumping into a pool, or starting an assignment")
104
  ```
105
 
106
  <!--
@@ -130,16 +137,16 @@ preds = model(" Like jumping into a pool, or starting an assignment")
130
  ## Training Details
131
 
132
  ### Training Set Metrics
133
- | Training set | Min | Median | Max |
134
- |:-------------|:----|:-------|:-----|
135
- | Word count | 4 | 49.85 | 1083 |
136
 
137
  | Label | Training Sample Count |
138
  |:------|:----------------------|
139
- | 0.0 | 20 |
140
- | 1.0 | 20 |
141
- | 2.0 | 20 |
142
- | 3.0 | 20 |
143
 
144
  ### Training Hyperparameters
145
  - batch_size: (8, 8)
@@ -161,19 +168,7 @@ preds = model(" Like jumping into a pool, or starting an assignment")
161
  ### Training Results
162
  | Epoch | Step | Training Loss | Validation Loss |
163
  |:------:|:----:|:-------------:|:---------------:|
164
- | 0.0017 | 1 | 0.0931 | - |
165
- | 0.0833 | 50 | 0.001 | - |
166
- | 0.1667 | 100 | 0.0002 | - |
167
- | 0.25 | 150 | 0.0 | - |
168
- | 0.3333 | 200 | 0.0 | - |
169
- | 0.4167 | 250 | 0.0 | - |
170
- | 0.5 | 300 | 0.0 | - |
171
- | 0.5833 | 350 | 0.0 | - |
172
- | 0.6667 | 400 | 0.0 | - |
173
- | 0.75 | 450 | 0.0 | - |
174
- | 0.8333 | 500 | 0.0 | - |
175
- | 0.9167 | 550 | 0.0 | - |
176
- | 1.0 | 600 | 0.0 | - |
177
 
178
  ### Framework Versions
179
  - Python: 3.10.13
 
9
  metrics:
10
  - accuracy
11
  widget:
12
+ - text: ' I''ve been socially anxious for so long that I don''t even know what to
13
+ say and what to do when I actually go outside and interact with people It''s just
14
+ a stream of question and uncertainties'
15
+ - text: ' I feel like I sometimes go into my own bubble whenever I’m outside and
16
+ only notice things like my friends all of a sudden laughing, etc'
17
+ - text: ' 18m i messed up at basketball practice today and some teammates yelled at
18
+ me and i started getting tears but barely visible due to sweat'
19
+ - text: ' while potheads, sex addicts and bullies and all this shit get to live the
20
+ fun, free life without worry of what tbey do next The majority of people who lead
21
+ this sort of life will end up regretting it in the long run This is because i
22
+ always feel like i walk weird, Have a very asymetrical face (ugly), underdeveloped
23
+ jaw, i run weird my whole body just doesnt look right'
24
+ - text: ' In my own experience, I remember I would feel like I was riding high on
25
+ the crest of a wave of confidence often for days, weeks or even months at a time
26
+ But it wasn’t until I started to take other positive actions (as outlined in
27
+ my previous post), that I was able to extend the lengths of my waves of confidence
28
+ and then break free of the cycle of “highs and lowsâ€_x009d_ altogether But
29
+ it wasn’t until I started to take other positive actions (as outlined in my
30
+ previous post), that I was able to extend the lengths of my waves of confidence
31
+ and then break free of the cycle of “highs and lowsâ€_x009d_ altogether'
32
  pipeline_tag: text-classification
33
  inference: true
34
  model-index:
 
43
  split: test
44
  metrics:
45
  - type: accuracy
46
+ value: 0.49166666666666664
47
  name: Accuracy
48
  ---
49
 
 
75
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
76
 
77
  ### Model Labels
78
+ | Label | Examples |
79
+ |:------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
80
+ | 1 | <ul><li>') I started running/biking again) I started running/biking again) I started running/biking again I still go run/bike and work out at home, but it is a fight with myself to do that'</li><li>' I went out, visited some relatives of mine, rode my bicycle around the neighborhood and it felt great, even though i was still anxious'</li><li>' I function just fine outside because of wind and fresh air, also when it’s dark (in the club, movie theatre etc)'</li></ul> |
81
+ | 3 | <ul><li>' OMG YES Whenever I walk outside i actually dread it people look at me like im socially retarded (well I am but you get the point), like some sort of puppy, one time when I was walking a car pulled up next to me and the people inside asled if I needed help and everyone immidetaley fixated on me OMG YES Whenever I walk outside i actually dread it people look at me like im socially retarded (well I am but you get the point), like some sort of puppy, one time when I was walking a car pulled up next to me and the people inside asled if I needed help and everyone immidetaley fixated on me'</li><li>' while potheads, sex addicts and bullies and all this shit get to live the fun, free life without worry of what tbey do next The majority of people who lead this sort of life will end up regretting it in the long run This is because i always feel like i walk weird, Have a very asymetrical face (ugly), underdeveloped jaw, i run weird my whole body just doesnt look right'</li><li>" He told me I should call him on the weekend so maybe we could do something like go swimming and gave me his number If you say let's go to the beach right now I may say fuck it let's go He told me I should call him on the weekend so maybe we could do something like go swimming and gave me his number"</li></ul> |
82
+ | 2 | <ul><li>' The fear all started when last summer when my family was on vacation going golfing The fear all started when last summer when my family was on vacation going golfing It was my turn and so I went up to the ball with my golf club and there was a big group of teen girls sitting on a bench looking directly at me and I heard one of them say "Look at his smile" and they all laughed'</li><li>"Yep I only go running once it's dark (around 7pm) because then people can't see me very well and don't judge me"</li><li>' I feel like I sometimes go into my own bubble whenever I’m outside and only notice things like my friends all of a sudden laughing, etc'</li></ul> |
83
+ | 0 | <ul><li>' Humans are by nature social creatures that rely on each other a lot'</li><li>' But reflecting on past experiences with it- some moments can be quite comical from an outside view'</li><li>' 18m i messed up at basketball practice today and some teammates yelled at me and i started getting tears but barely visible due to sweat'</li></ul> |
84
 
85
  ## Evaluation
86
 
87
  ### Metrics
88
  | Label | Accuracy |
89
  |:--------|:---------|
90
+ | **all** | 0.4917 |
91
 
92
  ## Uses
93
 
 
107
  # Download from the 🤗 Hub
108
  model = SetFitModel.from_pretrained("Omar-Nasr/setfitmodel")
109
  # Run inference
110
+ preds = model(" 18m i messed up at basketball practice today and some teammates yelled at me and i started getting tears but barely visible due to sweat")
111
  ```
112
 
113
  <!--
 
137
  ## Training Details
138
 
139
  ### Training Set Metrics
140
+ | Training set | Min | Median | Max |
141
+ |:-------------|:----|:--------|:----|
142
+ | Word count | 14 | 49.8125 | 119 |
143
 
144
  | Label | Training Sample Count |
145
  |:------|:----------------------|
146
+ | 0 | 4 |
147
+ | 1 | 4 |
148
+ | 2 | 4 |
149
+ | 3 | 4 |
150
 
151
  ### Training Hyperparameters
152
  - batch_size: (8, 8)
 
168
  ### Training Results
169
  | Epoch | Step | Training Loss | Validation Loss |
170
  |:------:|:----:|:-------------:|:---------------:|
171
+ | 0.0417 | 1 | 0.4679 | - |
 
 
 
 
 
 
 
 
 
 
 
 
172
 
173
  ### Framework Versions
174
  - Python: 3.10.13
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d74b9e693c4bec6d33454703d1b488f06cf5995a92c194f7ffd30fe86d02b5dc
3
  size 1421483904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b22fea00ab1fc96f339fe5e5e61364f9013350a2510970c8cbac236d7bba1a00
3
  size 1421483904
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9cde52a221254c0bce19882f7cf15d51fa94308dabee07838bf700e1af322569
3
- size 33639
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7fe8aceb2bdfe5d99d26698caa633d1f00ef457df45bd4712428fbabfb2f581
3
+ size 33671