Edit model card

SetFit with sentence-transformers/paraphrase-MiniLM-L3-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-MiniLM-L3-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. Fine-tuning a Sentence Transformer with contrastive learning.
  2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Sources

Model Labels

Label Examples
28
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Chilled Water Flow'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 1 CHW Flowrate'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHW Flowrate'
33
  • 'Tiong Bahru Plaza, UC800_102005, Cond Water Flow'
  • 'Tiong Bahru Plaza, UC800_102005, Condenser Water Flow'
  • 'Tiong Bahru Plaza, UC800_102004, Condenser Water Flow'
2
  • 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 FAD Feedback'
  • 'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 FAD feedback'
  • 'Tiong Bahru Plaza, DDC L14-1, AHU 13-1 FAD Feedback'
42
  • 'Tiong Bahru Plaza, UC800_102004, Cond Leaving Water Temp (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_102004, Cond Leaving Water Temp (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_102005, Cond Entering Water Temp (Units: °C)'
31
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWR Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Head CWR Temp'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWR Temp'
9
  • 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-02 supply air temperature (Units: °C).2'
  • 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 supply air temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-03 supply air temperature (Units: °C)'
1
  • 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-02 static pressure (Units: Pa)'
  • 'Tiong Bahru Plaza, DDC-L2-5, PAU-L2-02 static pressure (Units: Pa)'
  • 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 Static pressure (Units: Pa)'
25
  • 'Tiong Bahru Plaza, DDC-L1-3, AHU-L2-02 VSD control'
  • 'Tiong Bahru Plaza, DDC-L2-5, PAU-L2-04 VSD control'
  • 'Tiong Bahru Plaza, DDC-L3-2, AHU-6-2A VSD control'
12
  • 'Tiong Bahru Plaza, DDC-9-1, AHU 8-1 On/Off Status'
  • 'Tiong Bahru Plaza, DDC-9-1, AHU 7-1 On/Off Status'
  • 'Tiong Bahru Plaza, DDC-L1-5, PAU-L1-06 on/off status'
8
  • 'Tiong Bahru Plaza, DDC-L1-3, AHU-L1-02 returm air temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC-L1-1, AHU-L1-01 returm air temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC L2-4, AHU L2-04 returm air temperature (Units: °C)'
24
  • 'Tiong Bahru Plaza, DDC-L20, PAHU TR-1 TEMPERATURE (Units: °C)'
13
  • 'Tiong Bahru Plaza, DDC-L17, AHU 17-1 Smoke Alarm'
  • 'Tiong Bahru Plaza, DDC-9-1, AHU 9-1 Smoke Alarm'
  • 'Tiong Bahru Plaza, DDC-B1-6, AHU-B1-1 Smoke Alarm'
30
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Head CWS Temp'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temp'
5
  • 'Tiong Bahru Plaza, DDC-L20, AHU 19-1 OCT (Units: °C)'
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 OCT (Units: °C)'
  • 'Tiong Bahru Plaza, DDC L14-1, AHU 13-1 OCT (Units: °C)'
43
  • 'Tiong Bahru Plaza, VAV 19-11, Air Valve Position (Units: %)'
  • 'Tiong Bahru Plaza, VAV 19-13, Air Valve Position (Units: %)'
  • 'Tiong Bahru Plaza, VAV 19-16, Air Valve Position (Units: %)'
14
  • 'Tiong Bahru Plaza, DDC-L1-5, AHU-L3-04A trip alarm'
  • 'Tiong Bahru Plaza, DDC-9-1, AHU 9-1 Trip Alarm'
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 Trip Alarm'
36
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CHWR Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWR Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CWR Temperature'
34
  • 'Tiong Bahru Plaza, UC800_3, Operating Mode'
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Operating Mode'
  • 'CT 3-1 Switch Mode'
18
  • 'Tiong Bahru Plaza, DDC-L2-5, PAU-L2-04 switch mode'
  • 'Tiong Bahru Plaza, DDC-L3-3, AHU-L3-1 switch mode'
  • 'Tiong Bahru Plaza, DDC L2-4, AHU L2-04 switch mode'
6
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 Valve Control (Units: %)'
  • 'Tiong Bahru Plaza, DDC-L20, AHU 20-1 VALVE CONTROL (Units: %)'
  • 'Tiong Bahru Plaza, DDC L12, AHU 10-1 VALVE CONTROL (Units: %)'
17
  • 'Tiong Bahru Plaza, VAV 19-12, Discharge Air Temperature (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 19-15, Discharge Air Temperature (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 19-7, Discharge Air Temperature (Units: °C)'
0
  • 'Tiong Bahru Plaza, DDC L14-1, AHU 13-1 CO2 Reading (Units: ppm).1'
  • 'Tiong Bahru Plaza, DDC-L1-5, AHU-L3-04A CO2 sensor reading (Units: ppm)'
  • 'Tiong Bahru Plaza, DDC-L20, Co2 Level 18'
29
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temp'
15
  • 'Tiong Bahru Plaza, VAV 19-6, Space Temperature (Units: °C).1'
  • 'Tiong Bahru Plaza, VAV-19-3, Space Temperature (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 19-17A, Space Temperature (Units: °C)'
11
  • 'DDC-CH-3:CH 3 Start/Stop Control'
  • 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 Start/Stop Control'
  • 'Tiong Bahru Plaza, DDC L14-1, AHU12-1 Start/Stop'
32
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Chilled Water Flow'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 4 CHW Flowrate'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CHW Flowrate'
27
  • 'Tiong Bahru Plaza, LSB-U4-1, Active Power kW'
  • 'Tiong Bahru Plaza, MB-1-S2, Active Power kW'
  • 'Tiong Bahru Plaza, MB-1-S3, Active Power kW'
41
  • ' Chiller SC:Header Differential Pressure'
40
  • 'Wet Bulb Temperature'
3
  • 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 FAD Control'
  • 'Tiong Bahru Plaza, DDC-L20, L20 Fresh air damper control (Units: %)'
  • 'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 FAD control (Units: %)'
22
  • 'Tiong Bahru Plaza, VAV 19-2, Active Setpoint (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 18-17, Active Setpoint (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 19-16, Active Setpoint (Units: °C)'
21
  • 'Tiong Bahru Plaza, VAV 19-19, Air Flow Setpoint Active (Units: m3/h)'
  • 'Tiong Bahru Plaza, VAV 19-22, Air Flow Setpoint Active (Units: m3/h)'
  • 'Tiong Bahru Plaza, VAV 19-9, Air Flow Setpoint Active (Units: m3/h)'
26
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temp'
23
  • 'Tiong Bahru Plaza, DDC B1-3, Pau-B1-02-DP Sensor'
16
  • 'Tiong Bahru Plaza, VAV 19-9, Discharge Air Flow (Units: m3/h)'
  • 'Tiong Bahru Plaza, VAV 19-18, Discharge Air Flow (Units: m3/h)'
  • 'Tiong Bahru Plaza, VAV 19-15, Discharge Air Flow (Units: m3/h)'
39
  • 'Tiong Bahru Plaza, UC800_3, Evaporator Refrigerant Pressure - Circuit 1 (Units: Pa)'
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Evaporator Refrigerant Pressure - Circuit 1 (Units: Pa)'
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Evaporator Refrigerant Pressure - Circuit 1 (Units: Pa)'
7
  • 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-02 modulating valve feedback (Units: %).3'
  • 'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 modulating valve feedback'
  • 'Tiong Bahru Plaza, DDC B1-4, PAU-B1-1 modulating valve feedback'
37
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 4 CWS Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CWS Temperature'
20
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C).2'
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C).1'
35
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Condenser Saturated Refrigerant Temperature Circuit 1 (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_3, Condenser Saturated Refrigerant Temperature Circuit 1 (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Evaporator Saturated Refrigerant Temperature - Circuit 1 (Units: °C)'
4
  • 'Tiong Bahru Plaza, DDC-9-1, AHU 9-1 Flow'
  • 'Tiong Bahru Plaza, DDC-L6, AHU 5-3 Flow'
  • 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 Flow'
19
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %).2'
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %)'
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %).1'
38
  • 'Tiong Bahru Plaza, UC800_3, Entering Condenser Water (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Entering Condenser Water (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Entering Condenser Water (Units: °C)'
10
  • 'Tiong Bahru Plaza, DDC-L1-3, AHU-L2-02 VSD feedback'
  • 'DDC-CH-3:CWP 3 VSD Feedback'
  • 'Tiong Bahru Plaza, DDC-L2-8, PAU-L2-03 VSD feedback'

Evaluation

Metrics

Label Accuracy
all 0.9864

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Varun1010/all-MiniLM-L6-v2-polaris-more")
# Run inference
preds = model("Tiong Bahru Plaza, DDC-L20, AHU 20-1 VSD CONTROL")

Training Details

Training Set Metrics

Training set Min Median Max
Word count 3 8.7134 13
Label Training Sample Count
0 4
1 4
2 4
3 4
4 4
5 4
6 4
7 4
8 4
9 4
10 4
11 4
12 4
13 4
14 4
15 4
16 4
17 4
18 4
19 3
20 3
21 4
22 4
23 1
24 1
25 4
26 4
27 4
28 4
29 4
30 3
31 3
32 4
33 4
34 4
35 4
36 4
37 4
38 3
39 3
40 1
41 1
42 3
43 4

Training Hyperparameters

  • batch_size: (64, 64)
  • num_epochs: (5, 5)
  • max_steps: -1
  • sampling_strategy: oversampling
  • body_learning_rate: (2e-05, 1e-05)
  • head_learning_rate: 0.01
  • loss: CosineSimilarityLoss
  • distance_metric: cosine_distance
  • margin: 0.25
  • end_to_end: False
  • use_amp: False
  • warmup_proportion: 0.1
  • seed: 42
  • eval_max_steps: -1
  • load_best_model_at_end: False

Training Results

Epoch Step Training Loss Validation Loss
0.0027 1 0.1538 -
0.1330 50 0.0495 -
0.2660 100 0.0655 -
0.3989 150 0.0336 -
0.5319 200 0.0282 -
0.6649 250 0.0207 -
0.7979 300 0.0184 -
0.9309 350 0.0163 -
1.0638 400 0.0088 -
1.1968 450 0.0307 -
1.3298 500 0.0153 -
1.4628 550 0.0079 -
1.5957 600 0.02 -
1.7287 650 0.0165 -
1.8617 700 0.0087 -
1.9947 750 0.0236 -
2.1277 800 0.0108 -
2.2606 850 0.0071 -
2.3936 900 0.0137 -
2.5266 950 0.0104 -
2.6596 1000 0.0054 -
2.7926 1050 0.0058 -
2.9255 1100 0.0052 -
3.0585 1150 0.0053 -
3.1915 1200 0.004 -
3.3245 1250 0.0047 -
3.4574 1300 0.0176 -
3.5904 1350 0.0046 -
3.7234 1400 0.0139 -
3.8564 1450 0.0043 -
3.9894 1500 0.0042 -
4.1223 1550 0.0112 -
4.2553 1600 0.0091 -
4.3883 1650 0.0045 -
4.5213 1700 0.009 -
4.6543 1750 0.0097 -
4.7872 1800 0.0049 -
4.9202 1850 0.0036 -

Framework Versions

  • Python: 3.10.12
  • SetFit: 1.0.3
  • Sentence Transformers: 2.6.1
  • Transformers: 4.38.2
  • PyTorch: 2.2.1+cu121
  • Datasets: 2.18.0
  • Tokenizers: 0.15.2

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
Downloads last month
470
Safetensors
Model size
17.4M params
Tensor type
F32
·

Finetuned from

Evaluation results