Varun1010/all-MiniLM-L6-v2-polaris-tb-new

SetFit with sentence-transformers/paraphrase-MiniLM-L3-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-MiniLM-L3-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

1. Fine-tuning a Sentence Transformer with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

• Model Type: SetFit
• Sentence Transformer body: sentence-transformers/paraphrase-MiniLM-L3-v2
• Classification head: a LogisticRegression instance
• Maximum Sequence Length: 128 tokens
• Number of Classes: 47 classes

Model Sources

• Repository: SetFit on GitHub
• Paper: Efficient Few-Shot Learning Without Prompts
• Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
28	'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temp' 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temperature' 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temperature'
6	'Tiong Bahru Plaza, DDC-L1-3, AHU-L2-02 modulating valve feedback' 'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 modulating valve feedback' 'Tiong Bahru Plaza, DDC-L2-5, PAU-L2-04 modulating valve feedback'
15	'Tiong Bahru Plaza, VAV 19-6, Discharge Air Flow (Units: m3/h)' 'Tiong Bahru Plaza, VAV 18-17, Discharge Air Flow (Units: m3/h)' 'Tiong Bahru Plaza, VAV 19-10, Discharge Air Flow (Units: m3/h)'
43	'Tiong Bahru Plaza, UC800_101001_CH_1, Chilled Water Setpoint (Units: ¬?C)' 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Chilled Water Setpoint (Units: ¬?C)' 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Chilled Water Setpoint (Units: ¬?C)'
4	'Tiong Bahru Plaza, DDC L12, AHU 10-1 FLOW' 'Tiong Bahru Plaza, DDC L14-1, AHU 12-1 Flow (Units: Pa)' 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 Flow'
0	'Tiong Bahru Plaza, DDC-L20, Co2 Level 18' 'Tiong Bahru Plaza, DDC L14-1, AHU 15-1 CO2 Reading (Units: ppm).1' 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 CO2.1'
10	'Tiong Bahru Plaza, DDC-9-1, AHU7-1 Start/Stop Control' 'Tiong Bahru Plaza, DDC L14-1, AHU13-1 Start/Stop' 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 Start/Stop Control'
40	'Tiong Bahru Plaza, VAV 19-21, Air Valve Position (Units: %)' 'Tiong Bahru Plaza, VAV 18-17, Air Valve Position (Units: %)' 'Tiong Bahru Plaza, VAV 19-12, Air Valve Position (Units: %)'
26	'Tiong Bahru Plaza, MB-1-S3, Active Power kW' 'Tiong Bahru Plaza, MB-1-S2, Active Power kW' 'Tiong Bahru Plaza, LCP-AC-ACCH-01, Active Power kW'
5	'Tiong Bahru Plaza, DDC L12, AHU 10-1 VALVE CONTROL (Units: %)' 'Tiong Bahru Plaza, DDC-9-1, AHU 6-3 Valve Control' 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 valve control (Units: %)'
2	'Tiong Bahru Plaza, DDC-L20, L19 Fresh air damper feedback (Units: %)' 'Tiong Bahru Plaza, DDC-L1-3, AHU-L2-02 FAD feedback' 'Tiong Bahru Plaza, DDC L14-1, AHU 13-1 FAD Feedback'
32	'CT 3-1 Switch Mode' 'Tiong Bahru Plaza, UC800_3, Operating Mode' 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Operating Mode'
34	'Tiong Bahru Plaza, DDC-CH-2, CH 2 CHWR TEMPERATURE (Units: ¬?C)' 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CHWR Temperature' 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 1 CHWR Temperature'
24	'Tiong Bahru Plaza, DDC-L1-5, PAU-L1-06 VSD control' 'Tiong Bahru Plaza, DDC-L3-01, PAU-L3-03 VSD control' 'Tiong Bahru Plaza, DDC-L3-2, PAU-L3-01 VSD control'
39	'Tiong Bahru Plaza, TBP_UNO_Server, Chiller 1_CWRT' 'Tiong Bahru Plaza, TBP_UNO_Server, CH1_CWRT' 'Tiong Bahru Plaza, UC800_102005, Cond Entering Water Temp (Units: °C)'
13	'Tiong Bahru Plaza, DDC L14-1, AHU 14-1 TRIP ALARM' 'Tiong Bahru Plaza, DDC B1-3, Pau-B1-02-Trip Alarm' 'Tiong Bahru Plaza, DDC-B1-5, AHU-B1-2-Trip'
9	'Tiong Bahru Plaza, DDC-L3-2, AHU-6-2A VSD feedback' 'Tiong Bahru Plaza, DDC-L1-5, AHU-L3-04A VSD feedback' 'Tiong Bahru Plaza, DDC-L1-1, PAU-L1-01 VSD feedback'
17	'Tiong Bahru Plaza, DDC-L1-3, PAU-L1-02 switch mode' 'Tiong Bahru Plaza, DDC-L2-6, PAU-L2-01 switch mode' 'Tiong Bahru Plaza, DDC B1-3, Pau-B1-02-Switch Mode'
14	'Tiong Bahru Plaza, VAV 19-21, Space Temperature (Units: °C)' 'Tiong Bahru Plaza, VAV 19-11, Space Temperature (Units: °C)' 'Tiong Bahru Plaza, VAV-19-3, Space Temperature (Units: °C)'
45	'Tiong Bahru Plaza, DDC-CH-4, CHWP 4 VSD Feedback' 'Tiong Bahru Plaza, DDC-CH-4, Cooling Tower 4-1 VSD Feedback' 'Tiong Bahru Plaza, DDC-CH-4, Condenser Water Pump 4 VSD Feedback'
27	'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 1 CHW Flowrate' 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 4 CHW Flowrate' 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CHW Flowrate'
21	'Tiong Bahru Plaza, VAV 19-6, Active Setpoint (Units: °C)' 'Tiong Bahru Plaza, VAV 19-15, Active Setpoint (Units: °C)' 'Tiong Bahru Plaza, VAV 19-13, Active Setpoint (Units: °C)'
7	'Tiong Bahru Plaza, DDC-L2-5, AHU-L2-03 returm air temperature (Units: °C)' 'Tiong Bahru Plaza, DDC-L3-2, AHU-6-2A returm air temperature (Units: °C)' 'Tiong Bahru Plaza, DDC-L1-5, AHU-L3-04A returm air temperature (Units: °C)'
29	'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temp' 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temperature' 'Tiong Bahru Plaza, SC-10, Chiller SC, Head CWS Temp'
1	'Tiong Bahru Plaza, DDC B1-4, PAU-B1-1 Static pressure' 'Tiong Bahru Plaza, DDC-L3-2, PAU-L3-01 static pressure (Units: Pa)' 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 Static pressure (Units: Pa)'
46	'Tiong Bahru Plaza, SC-10, Chiller SC, System Condenser Water Supply Temperature Setpoint' 'Tiong Bahru Plaza, SC-10, Chiller SC, System Condenser Water Supply Temperature Setpoint' 'Tiong Bahru Plaza, SC-10, Chiller SC, System Condenser Water Supply Temperature Setpoint'
11	'Tiong Bahru Plaza, DDC-L17, AHU 16-1 On/Off Status' 'Tiong Bahru Plaza, DDC L14-1, AHU 14-1 ON/OFF STATUS' 'Tiong Bahru Plaza, DDC-9-1, AHU 8-1 On/Off Status'
33	'Tiong Bahru Plaza, UC800_102002_Chiller_2, Condenser Saturated Refrigerant Temperature Circuit 1 (Units: °C)' 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Evaporator Saturated Refrigerant Temperature - Circuit 1 (Units: °C)' 'Tiong Bahru Plaza, UC800_102004, Cond Saturated Refrigerant Temp Sensor Chiller'
8	'Tiong Bahru Plaza, DDC L4-1, PAU-L4-03 supply air temperature (Units: °C)' 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-03 supply air temperature (Units: °C).1' 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-02 supply air temperature (Units: °C).1'
16	'Tiong Bahru Plaza, VAV 19-11, Discharge Air Temperature (Units: °C)' 'Tiong Bahru Plaza, VAV 19-9, Discharge Air Temperature (Units: °C)' 'Tiong Bahru Plaza, VAV 18-2, Discharge Air Temperature (Units: °C)'
35	'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CHWS Temperature' 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 4 CHWS Temperature' 'Tiong Bahru Plaza, DDC-CH-2, CH 2 CHWS TEMPERATURE (Units: ¬?C)'
30	'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWR Temperature' 'Tiong Bahru Plaza, SC-10, Chiller SC, Head CWR Temp' 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWR Temp'
3	'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 FAD control (Units: %)' 'Tiong Bahru Plaza, DDC-L1-5, AHU-L3-04A FAD control' 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 FAD Control'
44	'Tiong Bahru Plaza, DDC-CH-1, Chiller 1 VSD Control' 'Tiong Bahru Plaza, DDC-CH-4, CWP 4 VSD Control' 'Tiong Bahru Plaza, DDC-CH-4, Condenser Water Pump 4 VSD Control'
20	'Tiong Bahru Plaza, VAV 19-13, Air Flow Setpoint Active (Units: m3/h)' 'Tiong Bahru Plaza, VAV 19-17A, Air Flow Setpoint Active (Units: m3/h)' 'Tiong Bahru Plaza, VAV-19-20, Air Flow Setpoint Active (Units: m3/h)'
23	'Tiong Bahru Plaza, DDC-L20, PAHU TR-1 TEMPERATURE (Units: °C)'
41	'Tiong Bahru Plaza, SC-10, Chiller SC, Total System Heat Balance' 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 1 Effficiency' 'Tiong Bahru Plaza, SC-10, Chiller SC, System Cooling Load'
25	'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temp' 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temp' 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temperature'
36	'Tiong Bahru Plaza, UC800_101001_Chiller_1, Entering Condenser Water (Units: °C)' 'Tiong Bahru Plaza, UC800_3, Entering Condenser Water (Units: °C)' 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Entering Condenser Water (Units: °C)'
12	'Tiong Bahru Plaza, DDC-L20, PAHU TR-1(R-1) SMOKE ALARM' 'Tiong Bahru Plaza, DDC-9-1, AHU 7-1 Smoke Alarm' 'Tiong Bahru Plaza, DDC-L3-3, AHU-L3-1 smoke alarm'
37	'Wet Bulb Temperature' 'Tiong Bahru Plaza, SC-4, wet bulb'
31	'Tiong Bahru Plaza, UC800_102005, Cond Water Flow' 'Tiong Bahru Plaza, UC800_102005, Condenser Water Flow' 'Tiong Bahru Plaza, UC800_102004, Cond Water Flow'
38	'Tiong Bahru Plaza, SC-10, Chiller SC, Header Differential Pressure' ' Chiller SC:Header Differential Pressure'
18	'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %)' 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %).1' 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %).2'
19	'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C).1' 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C)' 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C).2'
42	'Tiong Bahru Plaza, TBP Chiller Plant, Chilled Water Setpoint (Units: ¬?C)' 'Tiong Bahru Plaza, TBP Chiller Plant, Chilled Water Setpoint (Units: ¬?C)'
22	'Tiong Bahru Plaza, DDC B1-3, Pau-B1-02-DP Sensor'

Evaluation

Metrics

Label	Accuracy
all	0.8104

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Varun1010/all-MiniLM-L6-v2-polaris-tb-new")
# Run inference
preds = model("Tiong Bahru Plaza, DDC-L2-5, AHU-L2-03 trip alarm")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	5	8.4138	14

Label	Training Sample Count
0	10
1	10
2	10
3	10
4	10
5	10
6	10
7	10
8	10
9	10
10	10
11	10
12	10
13	10
14	10
15	10
16	10
17	10
18	3
19	3
20	10
21	10
22	1
23	1
24	10
25	4
26	10
27	8
28	4
29	3
30	3
31	4
32	4
33	9
34	5
35	4
36	3
37	2
38	2
39	9
40	10
41	4
42	2
43	3
44	8
45	8
46	3

Training Hyperparameters

• batch_size: (16, 16)
• num_epochs: (1, 16)
• max_steps: 500
• sampling_strategy: oversampling
• body_learning_rate: (2e-05, 1e-05)
• head_learning_rate: 0.01
• loss: CosineSimilarityLoss
• distance_metric: cosine_distance
• margin: 0.25
• end_to_end: False
• use_amp: False
• warmup_proportion: 0.1
• seed: 42
• eval_max_steps: -1
• load_best_model_at_end: False

Training Results

Epoch	Step	Training Loss	Validation Loss
0.0006	1	0.1561	-
0.0302	50	0.1223	-
0.0604	100	0.0757	-
0.0905	150	0.0607	-
0.1207	200	0.0505	-
0.1509	250	0.0571	-
0.1811	300	0.0287	-
0.2112	350	0.0362	-
0.2414	400	0.0214	-
0.2716	450	0.0239	-
0.3018	500	0.0315	-
0.3319	550	0.0174	-
0.3621	600	0.0316	-
0.3923	650	0.016	-
0.4225	700	0.0342	-
0.4526	750	0.0245	-
0.4828	800	0.0229	-
0.5130	850	0.0098	-
0.5432	900	0.0114	-
0.5733	950	0.0097	-
0.6035	1000	0.0149	-
0.6337	1050	0.0115	-
0.6639	1100	0.0107	-
0.6940	1150	0.0092	-
0.7242	1200	0.0068	-
0.7544	1250	0.0097	-
0.7846	1300	0.0305	-
0.8147	1350	0.0055	-
0.8449	1400	0.0068	-
0.8751	1450	0.0066	-
0.9053	1500	0.0101	-
0.9354	1550	0.0085	-
0.9656	1600	0.0056	-
0.9958	1650	0.0041	-
1.0260	1700	0.0117	-
1.0561	1750	0.0178	-
1.0863	1800	0.005	-
1.1165	1850	0.0086	-
1.1467	1900	0.0188	-
1.1768	1950	0.0106	-
1.2070	2000	0.0084	-
1.2372	2050	0.0054	-
1.2674	2100	0.0058	-
1.2975	2150	0.0089	-
1.3277	2200	0.0167	-
1.3579	2250	0.009	-
1.3881	2300	0.0108	-
1.4182	2350	0.0026	-
1.4484	2400	0.0076	-
1.4786	2450	0.003	-
1.5088	2500	0.0065	-
1.5389	2550	0.0066	-
1.5691	2600	0.0026	-
1.5993	2650	0.0156	-
1.6295	2700	0.0037	-
1.6596	2750	0.0021	-
1.6898	2800	0.0026	-
1.7200	2850	0.0059	-
1.7502	2900	0.0022	-
1.7803	2950	0.0109	-
1.8105	3000	0.0043	-
1.8407	3050	0.0032	-
1.8709	3100	0.0065	-
1.9010	3150	0.0043	-
1.9312	3200	0.0021	-
1.9614	3250	0.0018	-
1.9916	3300	0.0078	-
2.0217	3350	0.0058	-
2.0519	3400	0.0018	-
2.0821	3450	0.0032	-
2.1123	3500	0.0149	-
2.1424	3550	0.0078	-
2.1726	3600	0.0065	-
2.2028	3650	0.0026	-
2.2330	3700	0.0048	-
2.2631	3750	0.0027	-
2.2933	3800	0.003	-
2.3235	3850	0.0014	-
2.3537	3900	0.0031	-
2.3838	3950	0.0023	-
2.4140	4000	0.0021	-
2.4442	4050	0.002	-
2.4744	4100	0.002	-
2.5045	4150	0.0022	-
2.5347	4200	0.0063	-
2.5649	4250	0.004	-
2.5951	4300	0.0032	-
2.6252	4350	0.0022	-
2.6554	4400	0.0017	-
2.6856	4450	0.0014	-
2.7158	4500	0.0023	-
2.7459	4550	0.002	-
2.7761	4600	0.0021	-
2.8063	4650	0.0047	-
2.8365	4700	0.0026	-
2.8666	4750	0.0015	-
2.8968	4800	0.0014	-
2.9270	4850	0.0035	-
2.9572	4900	0.0012	-
2.9873	4950	0.0035	-
3.0175	5000	0.0011	-
3.0477	5050	0.0015	-
3.0779	5100	0.0012	-
3.1080	5150	0.0018	-
3.1382	5200	0.0013	-
3.1684	5250	0.0009	-
3.1986	5300	0.0176	-
3.2287	5350	0.014	-
3.2589	5400	0.0011	-
3.2891	5450	0.0013	-
3.3193	5500	0.0015	-
3.3494	5550	0.003	-
3.3796	5600	0.0043	-
3.4098	5650	0.001	-
3.4400	5700	0.0013	-
3.4701	5750	0.0021	-
3.5003	5800	0.0011	-
3.5305	5850	0.0011	-
3.5607	5900	0.0017	-
3.5908	5950	0.0019	-
3.6210	6000	0.0023	-
3.6512	6050	0.0012	-
3.6814	6100	0.0025	-
3.7115	6150	0.0033	-
3.7417	6200	0.0025	-
3.7719	6250	0.0009	-
3.8021	6300	0.0033	-
3.8322	6350	0.0031	-
3.8624	6400	0.0017	-
3.8926	6450	0.001	-
3.9228	6500	0.0015	-
3.9529	6550	0.001	-
3.9831	6600	0.0151	-
4.0133	6650	0.0015	-
4.0435	6700	0.0011	-
4.0736	6750	0.0012	-
4.1038	6800	0.0056	-
4.1340	6850	0.0029	-
4.1642	6900	0.0009	-
4.1943	6950	0.0014	-
4.2245	7000	0.0009	-
4.2547	7050	0.001	-
4.2849	7100	0.0017	-
4.3150	7150	0.0011	-
4.3452	7200	0.0013	-
4.3754	7250	0.0009	-
4.4056	7300	0.0012	-
4.4357	7350	0.0011	-
4.4659	7400	0.015	-
4.4961	7450	0.0009	-
4.5263	7500	0.001	-
4.5564	7550	0.0008	-
4.5866	7600	0.0053	-
4.6168	7650	0.0011	-
4.6470	7700	0.0009	-
4.6771	7750	0.0009	-
4.7073	7800	0.0011	-
4.7375	7850	0.0013	-
4.7677	7900	0.0009	-
4.7978	7950	0.0009	-
4.8280	8000	0.0011	-
4.8582	8050	0.0026	-
4.8884	8100	0.0012	-
4.9185	8150	0.0009	-
4.9487	8200	0.0027	-
4.9789	8250	0.0011	-
0.0020	1	0.9072	-
0.0998	50	0.4281	-
0.1996	100	0.0055	-
0.2994	150	0.0013	-
0.3992	200	0.0009	-
0.4990	250	0.0006	-
0.5988	300	0.0003	-
0.6986	350	0.0004	-
0.7984	400	0.0003	-
0.8982	450	0.0003	-
0.9980	500	0.0004	-

Framework Versions

• Python: 3.10.12
• SetFit: 1.0.3
• Sentence Transformers: 2.7.0
• Transformers: 4.38.2
• PyTorch: 2.2.1+cu121
• Datasets: 2.19.0
• Tokenizers: 0.15.2

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}