Add SetFit model

README.md

@@ -15,27 +15,33 @@ widget:
     attempt to increase tax revenues. A number of the most popular car models’ prices
     were about to increase – mostly large family, luxury and sport cars – but for
     many models, the retail price was actually reduced.
-- text: Facilitate transition of workers from the informal to the formal economy.
-    This will target the promotion and facilitation of access to SP programs such
-    as employment and entrepreneurship opportunities, social security schemes, social
-    services, and insurance systems.
-- text: environmental and climate awareness, public participation of youth organizations
-    and different local actors, teacher training in environmental education for climate
-    change, training and technical assistance for projects that allow communities
-    and citizens to access and acquire knowledge of environmental issues and of climate
-    change. The process of institutionalization of environmental education and culture
-    as public policy will promote the consolidation of comprehensive regulatory frameworks,
-    the incorporation of the environmental and climate dimension into educational
-    and cultural policies, the training of technical management teams and policy design.
-- text: SocialSecurityandCommunityDevelopment • Financially sound National Insurance
-    Services (NIS). • Extensive public assistance programmes for indigent and economically
-    disadvantaged persons. • Rich cultural heritage.
-- text: Incorporate a mechanism for monitoring and reviewing marine protected areas
-    management plans involving local populations;. Adopt a law to regulate marine
-    spatial planning by 2022 and/or revision and adaptation of the current basic law
-    of territorial planning and urban planning to include maritime spatial planning
-    (a tool that allows the zoning of activities to be developed at sea; law defining
-    the use of maritime space and maritime spatial planning);.
+- text: Workers in the formal sector. Formal sector workers also face economic risks.
+    A number of them experience income instability due to contractualization, retrenchment,
+    and firm closures. In 2014, contractual workers accounted for 22 percent of the
+    total 4.5 million workers employed in establishments with 20 or more employees.
+- text: Building additional dams and power stations to further develop energy generation
+    potential from the same river flow as well as develop new dam sites on parallel
+    rivers in order to maintain the baseline hydropower electricity generation capacity
+    to levels attainable under a ‘no-climate change’ scenario. Developing and implementing
+    climate change compatible building/construction codes for buildings, roads, airports,
+    airfields, dry ports, railways, bridges, dams and irrigation canals that are safe
+    for human life and minimize economic damage that is likely to result from increasing
+    extremes in flooding.
+- text: Another factor that increases farmer vulnerability is the remoteness of farm
+    villages and lack of adequate road infrastructure. Across the three regions, roads
+    are in a poor state and unevenly distributed, with many villages lacking roads
+    that connect them to other villages. Even the main roads are often accessible
+    only during the dry season. The livelihood implications of this isolation are
+    significant, as farmers have difficulties getting their products to markets as
+    well as obtaining agricultural inputs; in addition, farmers generally have to
+    pay higher prices for agricultural inputs in remote areas, reducing their profit
+    margins
+- text: This project aims to construct a desalination plant in the capital city in
+    order to respond directly to drinking water supply needs. This new plant, which
+    will have a capacity of 22,500 m3 daily, easily expandable to 45,000 m3, will
+    be fuelled by renewable energy, which is expected to be provided by a wind farm
+    planned for the second phase of the project. Funding: European Union. Rural Community
+    Development and Water Mobilization Project (PRODERMO).
 pipeline_tag: text-classification
 inference: false
 base_model: sentence-transformers/all-mpnet-base-v2
@@ -86,7 +92,7 @@ from setfit import SetFitModel
 # Download from the 🤗 Hub
 model = SetFitModel.from_pretrained("leavoigt/vulnerability_multilabel_updated")
 # Run inference
-preds = model("SocialSecurityandCommunityDevelopment • Financially sound National Insurance Services (NIS). • Extensive public assistance programmes for indigent and economically disadvantaged persons. • Rich cultural heritage.")
+preds = model("Workers in the formal sector. Formal sector workers also face economic risks. A number of them experience income instability due to contractualization, retrenchment, and firm closures. In 2014, contractual workers accounted for 22 percent of the total 4.5 million workers employed in establishments with 20 or more employees.")
 ```
 
 <!--
@@ -118,7 +124,7 @@ preds = model("SocialSecurityandCommunityDevelopment • Financially sound Natio
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 21  | 72.7143 | 238 |
+| Word count   | 21  | 72.6472 | 238 |
 
 ### Training Hyperparameters
 - batch_size: (16, 2)
@@ -140,14 +146,44 @@ preds = model("SocialSecurityandCommunityDevelopment • Financially sound Natio
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0006 | 1    | 0.3244        | -               |
-| 0.6309 | 1000 | 0.0331        | 0.1204          |
+| 0.0006 | 1    | 0.1906        | -               |
+| 0.0316 | 50   | 0.1275        | 0.1394          |
+| 0.0631 | 100  | 0.0851        | 0.1247          |
+| 0.0947 | 150  | 0.0959        | 0.1269          |
+| 0.1263 | 200  | 0.1109        | 0.1179          |
+| 0.1578 | 250  | 0.0923        | 0.1354          |
+| 0.1894 | 300  | 0.063         | 0.1292          |
+| 0.2210 | 350  | 0.0555        | 0.1326          |
+| 0.2525 | 400  | 0.0362        | 0.1127          |
+| 0.2841 | 450  | 0.0582        | 0.132           |
+| 0.3157 | 500  | 0.0952        | 0.1339          |
+| 0.3472 | 550  | 0.0793        | 0.1171          |
+| 0.3788 | 600  | 0.059         | 0.1187          |
+| 0.4104 | 650  | 0.0373        | 0.1131          |
+| 0.4419 | 700  | 0.0593        | 0.1144          |
+| 0.4735 | 750  | 0.0405        | 0.1174          |
+| 0.5051 | 800  | 0.0284        | 0.1196          |
+| 0.5366 | 850  | 0.0329        | 0.1116          |
+| 0.5682 | 900  | 0.0895        | 0.1193          |
+| 0.5997 | 950  | 0.0576        | 0.1159          |
+| 0.6313 | 1000 | 0.0385        | 0.1203          |
+| 0.6629 | 1050 | 0.0842        | 0.1195          |
+| 0.6944 | 1100 | 0.0274        | 0.113           |
+| 0.7260 | 1150 | 0.0226        | 0.1137          |
+| 0.7576 | 1200 | 0.0276        | 0.1204          |
+| 0.7891 | 1250 | 0.0355        | 0.1163          |
+| 0.8207 | 1300 | 0.077         | 0.1161          |
+| 0.8523 | 1350 | 0.0735        | 0.1135          |
+| 0.8838 | 1400 | 0.0357        | 0.1175          |
+| 0.9154 | 1450 | 0.0313        | 0.1207          |
+| 0.9470 | 1500 | 0.0241        | 0.1159          |
+| 0.9785 | 1550 | 0.0339        | 0.1161          |
 
 ### Framework Versions
 - Python: 3.10.12
 - SetFit: 1.0.3
 - Sentence Transformers: 2.3.1
-- Transformers: 4.37.2
+- Transformers: 4.38.1
 - PyTorch: 2.1.0+cu121
 - Datasets: 2.3.0
 - Tokenizers: 0.15.2

config.json

@@ -19,6 +19,6 @@
   "pad_token_id": 1,
   "relative_attention_num_buckets": 32,
   "torch_dtype": "float32",
-  "transformers_version": "4.37.2",
+  "transformers_version": "4.38.1",
   "vocab_size": 30527
 }

config_setfit.json

@@ -1,5 +1,4 @@
 {
-  "normalize_embeddings": true,
   "labels": [
     "Agricultural communities",
     "Children",
@@ -19,5 +18,6 @@
     "Sexual minorities (LGBTQI+)",
     "Urban populations",
     "Women and other genders"
-  ]
+  ],
+  "normalize_embeddings": true
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:824e8b534bf389debd8cd0a0bef7da9c396b04b8d1cbe229378fefed88a9520e
+oid sha256:fc5541650d65cf79ee8d7500f2e924fbcb0063e43ae6a2cfa1e79acb5b89d5c5
 size 437967672

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ba03ddb59157f208d69bc660203f8d171c4e816318b83777bbdf2e10e08bd2e4
+oid sha256:f3e1a9898cb62e49b33f8ab4771658997a423da599e0f1466da251f91e5d6d58
 size 56918