add model

README.md

@@ -6,20 +6,18 @@ model-index:
   results: []
 ---
 
-
+<!-- This model card has been generated automatically according to the information Keras had access to. You should
+probably proofread and complete it, then remove this comment. -->
 
 # US_politicians_covid_skepticism
 
-This model is a fine-tuned version of [vinai/bertweet-covid19-base-uncased](https://huggingface.co/vinai/bertweet-covid19-base-uncased) on a dataset of 20,000 handcoded tweets about COVID-19 policies sent by US legislators. The model is trained to identify tweets that are either in support of covid policies (masks, social distancing, lockdowns, vaccine mandates) or are opposed to such policies. Before training the model, all URLs and @Usernames were removed from the tweets. Accuracy is very high (probably) because US legislators tweet a lot of the same messages and retweet each other often. The model is uncased. 
-
-
-
+This model is a fine-tuned version of [vinai/bertweet-covid19-base-uncased](https://huggingface.co/vinai/bertweet-covid19-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 0.0141
-- Train Sparse Categorical Accuracy: 0.9968
-- Validation Loss: 0.0115
-- Validation Sparse Categorical Accuracy: 0.9970
-- Epoch: 2
+- Train Loss: 0.1007
+- Train Sparse Categorical Accuracy: 0.9591
+- Validation Loss: 0.0913
+- Validation Sparse Categorical Accuracy: 0.9627
+- Epoch: 1
 
 ## Model description
 
@@ -45,14 +43,13 @@ The following hyperparameters were used during training:
 
 | Train Loss | Train Sparse Categorical Accuracy | Validation Loss | Validation Sparse Categorical Accuracy | Epoch |
 |:----------:|:---------------------------------:|:---------------:|:--------------------------------------:|:-----:|
-| 0.1240     | 0.9721                            | 0.0206          | 0.9957                                 | 0     |
-| 0.0194     | 0.9957                            | 0.0117          | 0.9972                                 | 1     |
-| 0.0141     | 0.9968                            | 0.0115          | 0.9970                                 | 2     |
+| 0.1822     | 0.9345                            | 0.1021          | 0.9584                                 | 0     |
+| 0.1007     | 0.9591                            | 0.0913          | 0.9627                                 | 1     |
 
 
 ### Framework versions
 
-- Transformers 4.20.1
+- Transformers 4.21.0
 - TensorFlow 2.8.2
-- Datasets 2.3.2
+- Datasets 2.4.0
 - Tokenizers 0.12.1

config.json

@@ -21,7 +21,7 @@
   "pad_token_id": 1,
   "position_embedding_type": "absolute",
   "tokenizer_class": "BertweetTokenizer",
-  "transformers_version": "4.20.1",
+  "transformers_version": "4.21.0",
   "type_vocab_size": 1,
   "use_cache": true,
   "vocab_size": 64001

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7ed7dba631fa926f4aae5f64903d510b3492ffa845e4ea5f9f0d1950a81798ea
+oid sha256:62f52b9a863b7644bee9f7c1050edb86dba1f9fe97b7ce4d8da9766f57f6f753
 size 539895680