Add SetFit ABSA model

README.md

@@ -9,51 +9,54 @@ tags:
 metrics:
 - accuracy
 widget:
-- text: 'Wifi:Go get your coffee on.
-
-    Hey the coffee was strong, so what else?
-
-    Easy FWY on/off access
-
-    Close the beach
-
-    Other food choice nearby
-
-    Smaller starbucks, with less seating both indoors and outdoors
-
-    Wifi was slow at the time'
-- text: "place:Stopped by after a long day visit to Santa Barbara. There were few\
-    \ different places near by but remembering that 'smaller place with limited menu'\
-    \ has 70/30 chance of being better than a big place with big menu. It's generally\
-    \ a good ratio to keep in mind, and depending on the category of food, like sushi,\
-    \ it leans to a higher ratio like 80/20. \n\nOther places may have better seating\
-    \ and views, but I believe this place has better food. Their clam chowder was\
-    \ the best I've had so far in California (been here only for 5 months, I'm just\
-    \ getting started). Their 2 options of fresh oysters were good choices. Their\
-    \ lemonade was good and sweet. I just wished their shrimp cocktail came with more\
-    \ ...Cocktail. (Easy fix, just ask for more)"
-- text: "evening:Three reasons why it gets three stars:\n\n1. The crab cakes were\
-    \ good and is a definitely must try!\n2. The shrimp scampi was actually amazing\
-    \ in the sauce that it comes with, so that's another must try!\n3. The real reason\
-    \ why it is getting three stars is because service is everything in ANY restaurant\
-    \ you go to. Service started off great, waitress was attentive, but once we paid\
-    \ the bill and left a 20% tip, my guests and I, which was only three of us, stayed\
-    \ at the table to finish our drinks and we're looking at funny videos from a trip\
-    \ we went to. Point is the waitress rudely told my friend to lower the volume\
-    \ on his phone, yet other guests were just as loud and we  were sitting OUTSIDE...where\
-    \ it is already a loud environment! \n\nI really want to give it 4 stars, but\
-    \ if I give 4 stars it changes it to, \"Yay! I'm a fan\", but I am not. The only\
-    \ reason why it's not getting 1 star, is because the food was decent, the view\
-    \ is nice and also the manager was extremely empathetic to the situation and it\
-    \ wasn't her fault at all that her waitress was obviously having an off day. I\
-    \ have never met a manager that attentive and she was incredible at handling and\
-    \ diffusing the situation. I cannot thank her enough for salvaging the rest of\
-    \ our evening for how poor the waitress treated paying customers."
-- text: Mediterranean:Pretty good food, just had a wrap and it was delicious pretty
-    much on Mediterranean or Greek style food around here. Petra's who had really
-    good Greek dinners closed
-- text: sauce:The chicken made worth the waiting, my mild sauce was awesome, the honey
-    mustard my favorite
+- text: variety:I'm not sure what what I would do if I'd never discovered Nikka, since
+    it's the definitely the most authentic ramen one can get in the area. Prices are
+    standard for ramen (especially in SB) and the service is friendly and efficient.
+    Not only is Nikka's ramen amazing, their variety of appetizers is also great.
+    I've yet to try one that I don't like. Definitely come here if you're looking
+    to satisfy your ramen craving!
+- text: wrap:Pretty good food, just had a wrap and it was delicious pretty much on
+    Mediterranean or Greek style food around here. Petra's who had really good Greek
+    dinners closed
+- text: goat cheese:I had the Genoa Salami, Kalamata olive tapenade, with roasted
+    red peppers and goat cheese. I ended up going with this sandwich mainly because
+    I am lactose sensitive and found out that goat cheese is supposed to have less
+    lactose making it easier for the stomach to digest. The goat cheese had a nice
+    smooth and creamy flavor and when combined with the olive tapenade really made
+    a burst of flavor in my mouth. I also had the sandwich on Foccaica bread but they
+    also have three other choices of bread to choose from. Overall the sandwich was
+    delicious. I love the simple clean look of the store and it had some inside seating
+    as well as gated outdoor seating. All the staff members seemed very nice and helpful.
+    The one problem I had with Panino is the price. Although I love the sandwich,
+    I do not believe it is worth $12. When I originally looked up the menu on Yelp
+    I was looking at the pictures that were paired by other reviewers and I saw that
+    they were about $10. $10 still expensive but a little more understandable and
+    worth what you're getting.
+- text: toppings:FINALLY tried Mizza and wasn't disappointed. Loved (almost) everything
+    we ordered, great atmosphere, excellent service, and the perfect setting for a
+    lovely bday Sunday. The burrata & heirloom tomatoes app was scrumptious, the salmon
+    pasta, very flavorful and the salmon perfectly cooked, I liked the toppings of
+    the veggie pizza but wasn't a super fan of the crust (doesn't mean I won't come
+    back and try another pizza on their menu ) and the cannoli was good although that
+    dessert in general isn't my fave (it was my bf's bday so had to get what he wanted
+    ). The flourless chocolate cake and limoncello cake are what I'll try next time.
+    Had a great time and will be back. Gave it 4 stars just cuz I wasn't that excited
+    about the pizza and that's something they're supposed to so well. Would recommend
+    the restaurant though!
+- text: mouth:I had the Genoa Salami, Kalamata olive tapenade, with roasted red peppers
+    and goat cheese. I ended up going with this sandwich mainly because I am lactose
+    sensitive and found out that goat cheese is supposed to have less lactose making
+    it easier for the stomach to digest. The goat cheese had a nice smooth and creamy
+    flavor and when combined with the olive tapenade really made a burst of flavor
+    in my mouth. I also had the sandwich on Foccaica bread but they also have three
+    other choices of bread to choose from. Overall the sandwich was delicious. I love
+    the simple clean look of the store and it had some inside seating as well as gated
+    outdoor seating. All the staff members seemed very nice and helpful. The one problem
+    I had with Panino is the price. Although I love the sandwich, I do not believe
+    it is worth $12. When I originally looked up the menu on Yelp I was looking at
+    the pictures that were paired by other reviewers and I saw that they were about
+    $10. $10 still expensive but a little more understandable and worth what you're
+    getting.
 pipeline_tag: text-classification
 inference: false
 base_model: sentence-transformers/all-MiniLM-L6-v2
@@ -69,7 +72,7 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.9602649006622517
+      value: 0.956989247311828
       name: Accuracy
 ---
 
@@ -120,7 +123,7 @@ This model was trained within the context of a larger system for ABSA, which loo
 ### Metrics
 | Label   | Accuracy |
 |:--------|:---------|
-| **all** | 0.9603   |
+| **all** | 0.9570   |
 
 ## Uses
 
@@ -175,12 +178,12 @@ preds = model("The food was great, but the venue is just way too busy.")
 ### Training Set Metrics
 | Training set | Min | Median   | Max |
 |:-------------|:----|:---------|:----|
-| Word count   | 21  | 200.4733 | 491 |
+| Word count   | 21  | 152.7030 | 268 |
 
 | Label     | Training Sample Count |
 |:----------|:----------------------|
-| no aspect | 411                   |
-| aspect    | 20                    |
+| no aspect | 383                   |
+| aspect    | 21                    |
 
 ### Training Hyperparameters
 - batch_size: (50, 50)
@@ -202,21 +205,20 @@ preds = model("The food was great, but the venue is just way too busy.")
 ### Training Results
 | Epoch      | Step    | Training Loss | Validation Loss |
 |:----------:|:-------:|:-------------:|:---------------:|
-| 0.0003     | 1       | 0.2706        | -               |
-| 0.0147     | 50      | 0.2856        | 0.3049          |
-| 0.0294     | 100     | 0.2817        | 0.2904          |
-| 0.0442     | 150     | 0.2453        | 0.2837          |
-| 0.0589     | 200     | 0.2637        | 0.2756          |
-| 0.0736     | 250     | 0.199         | 0.2668          |
-| 0.0883     | 300     | 0.1917        | 0.2523          |
-| 0.1031     | 350     | 0.1071        | 0.1889          |
-| 0.1178     | 400     | 0.049         | 0.0826          |
-| **0.1325** | **450** | **0.022**     | **0.0718**      |
-| 0.1472     | 500     | 0.0275        | 0.0767          |
-| 0.1620     | 550     | 0.0152        | 0.0779          |
-| 0.1767     | 600     | 0.0185        | 0.0905          |
-| 0.1914     | 650     | 0.0044        | 0.0785          |
-| 0.2061     | 700     | 0.008         | 0.0896          |
+| 0.0003     | 1       | 0.2856        | -               |
+| 0.0169     | 50      | 0.2755        | 0.3092          |
+| 0.0339     | 100     | 0.2895        | 0.2962          |
+| 0.0508     | 150     | 0.2845        | 0.2876          |
+| 0.0678     | 200     | 0.2471        | 0.2826          |
+| 0.0847     | 250     | 0.2124        | 0.2691          |
+| 0.1017     | 300     | 0.1357        | 0.184           |
+| 0.1186     | 350     | 0.0362        | 0.0871          |
+| **0.1355** | **400** | **0.07**      | **0.0848**      |
+| 0.1525     | 450     | 0.0184        | 0.092           |
+| 0.1694     | 500     | 0.0179        | 0.096           |
+| 0.1864     | 550     | 0.0033        | 0.097           |
+| 0.2033     | 600     | 0.0037        | 0.0978          |
+| 0.2203     | 650     | 0.04          | 0.1046          |
 
 * The bold row denotes the saved checkpoint.
 ### Framework Versions
@@ -224,7 +226,7 @@ preds = model("The food was great, but the venue is just way too busy.")
 - SetFit: 1.0.3
 - Sentence Transformers: 2.6.0
 - spaCy: 3.7.4
-- Transformers: 4.39.1
+- Transformers: 4.38.2
 - PyTorch: 2.2.1+cu121
 - Datasets: 2.18.0
 - Tokenizers: 0.15.2

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "models/step_450",
+  "_name_or_path": "models/step_400",
   "architectures": [
     "BertModel"
   ],
@@ -19,7 +19,7 @@
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "torch_dtype": "float32",
-  "transformers_version": "4.39.1",
+  "transformers_version": "4.38.2",
   "type_vocab_size": 2,
   "use_cache": true,
   "vocab_size": 30522

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e9d06919a73b192295c0113d0b1353a8d70beba101c5c6668307cc8ea0ee22d6
+oid sha256:e573a59592709fb620050ee49692c250a6952412960a4daba4c7723ad59ff88e
 size 90864192

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9068d01421488717eeca7e48762fa2dcb717a2d9dd6b4be4e3851edf3c600a96
+oid sha256:bea6b3947fdff0d923557939878c49e5648729c8a250e8e97b64dd03ae886aba
 size 3919