Add SetFit model
Browse files- README.md +37 -42
- model.safetensors +1 -1
- model_head.pkl +2 -2
README.md
CHANGED
@@ -9,19 +9,26 @@ base_model: Omar-Nasr/setfitmodel
|
|
9 |
metrics:
|
10 |
- accuracy
|
11 |
widget:
|
12 |
-
- text: '
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
a
|
17 |
-
- text: '
|
18 |
-
|
19 |
-
- text: '
|
20 |
-
|
21 |
-
|
22 |
-
|
23 |
-
|
24 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
pipeline_tag: text-classification
|
26 |
inference: true
|
27 |
model-index:
|
@@ -36,7 +43,7 @@ model-index:
|
|
36 |
split: test
|
37 |
metrics:
|
38 |
- type: accuracy
|
39 |
-
value: 0.
|
40 |
name: Accuracy
|
41 |
---
|
42 |
|
@@ -68,19 +75,19 @@ The model has been trained using an efficient few-shot learning technique that i
|
|
68 |
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
|
69 |
|
70 |
### Model Labels
|
71 |
-
| Label | Examples
|
72 |
-
|
73 |
-
| 1
|
74 |
-
|
|
75 |
-
|
|
76 |
-
| 0
|
77 |
|
78 |
## Evaluation
|
79 |
|
80 |
### Metrics
|
81 |
| Label | Accuracy |
|
82 |
|:--------|:---------|
|
83 |
-
| **all** | 0.
|
84 |
|
85 |
## Uses
|
86 |
|
@@ -100,7 +107,7 @@ from setfit import SetFitModel
|
|
100 |
# Download from the 🤗 Hub
|
101 |
model = SetFitModel.from_pretrained("Omar-Nasr/setfitmodel")
|
102 |
# Run inference
|
103 |
-
preds = model("
|
104 |
```
|
105 |
|
106 |
<!--
|
@@ -130,16 +137,16 @@ preds = model(" Like jumping into a pool, or starting an assignment")
|
|
130 |
## Training Details
|
131 |
|
132 |
### Training Set Metrics
|
133 |
-
| Training set | Min | Median
|
134 |
-
|
135 |
-
| Word count |
|
136 |
|
137 |
| Label | Training Sample Count |
|
138 |
|:------|:----------------------|
|
139 |
-
| 0
|
140 |
-
| 1
|
141 |
-
| 2
|
142 |
-
| 3
|
143 |
|
144 |
### Training Hyperparameters
|
145 |
- batch_size: (8, 8)
|
@@ -161,19 +168,7 @@ preds = model(" Like jumping into a pool, or starting an assignment")
|
|
161 |
### Training Results
|
162 |
| Epoch | Step | Training Loss | Validation Loss |
|
163 |
|:------:|:----:|:-------------:|:---------------:|
|
164 |
-
| 0.
|
165 |
-
| 0.0833 | 50 | 0.001 | - |
|
166 |
-
| 0.1667 | 100 | 0.0002 | - |
|
167 |
-
| 0.25 | 150 | 0.0 | - |
|
168 |
-
| 0.3333 | 200 | 0.0 | - |
|
169 |
-
| 0.4167 | 250 | 0.0 | - |
|
170 |
-
| 0.5 | 300 | 0.0 | - |
|
171 |
-
| 0.5833 | 350 | 0.0 | - |
|
172 |
-
| 0.6667 | 400 | 0.0 | - |
|
173 |
-
| 0.75 | 450 | 0.0 | - |
|
174 |
-
| 0.8333 | 500 | 0.0 | - |
|
175 |
-
| 0.9167 | 550 | 0.0 | - |
|
176 |
-
| 1.0 | 600 | 0.0 | - |
|
177 |
|
178 |
### Framework Versions
|
179 |
- Python: 3.10.13
|
|
|
9 |
metrics:
|
10 |
- accuracy
|
11 |
widget:
|
12 |
+
- text: ' I''ve been socially anxious for so long that I don''t even know what to
|
13 |
+
say and what to do when I actually go outside and interact with people It''s just
|
14 |
+
a stream of question and uncertainties'
|
15 |
+
- text: ' I feel like I sometimes go into my own bubble whenever I’m outside and
|
16 |
+
only notice things like my friends all of a sudden laughing, etc'
|
17 |
+
- text: ' 18m i messed up at basketball practice today and some teammates yelled at
|
18 |
+
me and i started getting tears but barely visible due to sweat'
|
19 |
+
- text: ' while potheads, sex addicts and bullies and all this shit get to live the
|
20 |
+
fun, free life without worry of what tbey do next The majority of people who lead
|
21 |
+
this sort of life will end up regretting it in the long run This is because i
|
22 |
+
always feel like i walk weird, Have a very asymetrical face (ugly), underdeveloped
|
23 |
+
jaw, i run weird my whole body just doesnt look right'
|
24 |
+
- text: ' In my own experience, I remember I would feel like I was riding high on
|
25 |
+
the crest of a wave of confidence often for days, weeks or even months at a time
|
26 |
+
But it wasn’t until I started to take other positive actions (as outlined in
|
27 |
+
my previous post), that I was able to extend the lengths of my waves of confidence
|
28 |
+
and then break free of the cycle of “highs and lowsâ€_x009d_ altogether But
|
29 |
+
it wasn’t until I started to take other positive actions (as outlined in my
|
30 |
+
previous post), that I was able to extend the lengths of my waves of confidence
|
31 |
+
and then break free of the cycle of “highs and lowsâ€_x009d_ altogether'
|
32 |
pipeline_tag: text-classification
|
33 |
inference: true
|
34 |
model-index:
|
|
|
43 |
split: test
|
44 |
metrics:
|
45 |
- type: accuracy
|
46 |
+
value: 0.49166666666666664
|
47 |
name: Accuracy
|
48 |
---
|
49 |
|
|
|
75 |
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
|
76 |
|
77 |
### Model Labels
|
78 |
+
| Label | Examples |
|
79 |
+
|:------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
80 |
+
| 1 | <ul><li>') I started running/biking again) I started running/biking again) I started running/biking again I still go run/bike and work out at home, but it is a fight with myself to do that'</li><li>' I went out, visited some relatives of mine, rode my bicycle around the neighborhood and it felt great, even though i was still anxious'</li><li>' I function just fine outside because of wind and fresh air, also when it’s dark (in the club, movie theatre etc)'</li></ul> |
|
81 |
+
| 3 | <ul><li>' OMG YES Whenever I walk outside i actually dread it people look at me like im socially retarded (well I am but you get the point), like some sort of puppy, one time when I was walking a car pulled up next to me and the people inside asled if I needed help and everyone immidetaley fixated on me OMG YES Whenever I walk outside i actually dread it people look at me like im socially retarded (well I am but you get the point), like some sort of puppy, one time when I was walking a car pulled up next to me and the people inside asled if I needed help and everyone immidetaley fixated on me'</li><li>' while potheads, sex addicts and bullies and all this shit get to live the fun, free life without worry of what tbey do next The majority of people who lead this sort of life will end up regretting it in the long run This is because i always feel like i walk weird, Have a very asymetrical face (ugly), underdeveloped jaw, i run weird my whole body just doesnt look right'</li><li>" He told me I should call him on the weekend so maybe we could do something like go swimming and gave me his number If you say let's go to the beach right now I may say fuck it let's go He told me I should call him on the weekend so maybe we could do something like go swimming and gave me his number"</li></ul> |
|
82 |
+
| 2 | <ul><li>' The fear all started when last summer when my family was on vacation going golfing The fear all started when last summer when my family was on vacation going golfing It was my turn and so I went up to the ball with my golf club and there was a big group of teen girls sitting on a bench looking directly at me and I heard one of them say "Look at his smile" and they all laughed'</li><li>"Yep I only go running once it's dark (around 7pm) because then people can't see me very well and don't judge me"</li><li>' I feel like I sometimes go into my own bubble whenever I’m outside and only notice things like my friends all of a sudden laughing, etc'</li></ul> |
|
83 |
+
| 0 | <ul><li>' Humans are by nature social creatures that rely on each other a lot'</li><li>' But reflecting on past experiences with it- some moments can be quite comical from an outside view'</li><li>' 18m i messed up at basketball practice today and some teammates yelled at me and i started getting tears but barely visible due to sweat'</li></ul> |
|
84 |
|
85 |
## Evaluation
|
86 |
|
87 |
### Metrics
|
88 |
| Label | Accuracy |
|
89 |
|:--------|:---------|
|
90 |
+
| **all** | 0.4917 |
|
91 |
|
92 |
## Uses
|
93 |
|
|
|
107 |
# Download from the 🤗 Hub
|
108 |
model = SetFitModel.from_pretrained("Omar-Nasr/setfitmodel")
|
109 |
# Run inference
|
110 |
+
preds = model(" 18m i messed up at basketball practice today and some teammates yelled at me and i started getting tears but barely visible due to sweat")
|
111 |
```
|
112 |
|
113 |
<!--
|
|
|
137 |
## Training Details
|
138 |
|
139 |
### Training Set Metrics
|
140 |
+
| Training set | Min | Median | Max |
|
141 |
+
|:-------------|:----|:--------|:----|
|
142 |
+
| Word count | 14 | 49.8125 | 119 |
|
143 |
|
144 |
| Label | Training Sample Count |
|
145 |
|:------|:----------------------|
|
146 |
+
| 0 | 4 |
|
147 |
+
| 1 | 4 |
|
148 |
+
| 2 | 4 |
|
149 |
+
| 3 | 4 |
|
150 |
|
151 |
### Training Hyperparameters
|
152 |
- batch_size: (8, 8)
|
|
|
168 |
### Training Results
|
169 |
| Epoch | Step | Training Loss | Validation Loss |
|
170 |
|:------:|:----:|:-------------:|:---------------:|
|
171 |
+
| 0.0417 | 1 | 0.4679 | - |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
172 |
|
173 |
### Framework Versions
|
174 |
- Python: 3.10.13
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1421483904
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b22fea00ab1fc96f339fe5e5e61364f9013350a2510970c8cbac236d7bba1a00
|
3 |
size 1421483904
|
model_head.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f7fe8aceb2bdfe5d99d26698caa633d1f00ef457df45bd4712428fbabfb2f581
|
3 |
+
size 33671
|