Hugging Face's logo

Varun1010
/
all-MiniLM-L6-v2-polaris-setfit

Text Classification
setfit
Safetensors
sentence-transformers
bert
generated_from_setfit_trainer
Eval Results
Model card Files Community
Edit model card

SetFit with sentence-transformers/paraphrase-MiniLM-L3-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-MiniLM-L3-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. Fine-tuning a Sentence Transformer with contrastive learning.
  2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Sources

Model Labels

Label Examples
2
  • 'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 FAD feedback'
  • 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 FAD Feedback'
32
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 1 CHW Flowrate'
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Chilled Water Flow'
1
  • 'Tiong Bahru Plaza, DDC-L2-5, PAU-L2-02 static pressure (Units: Pa)'
  • 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 Static pressure (Units: Pa)'
30
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temp'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temperature'
42
  • 'Tiong Bahru Plaza, UC800_102004, Cond Leaving Water Temp (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_102004, Cond Leaving Water Temp (Units: °C)'
13
  • 'Tiong Bahru Plaza, DDC L12, AHU 10-1 SMOKE ALARM'
  • 'Tiong Bahru Plaza, DDC-L17, AHU 17-1 Smoke Alarm'
35
  • 'Tiong Bahru Plaza, UC800_3, Condenser Saturated Refrigerant Temperature Circuit 1 (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_102004, Cond Saturated Refrigerant Temp Sensor Chiller'
21
  • 'Tiong Bahru Plaza, VAV 19-14, Air Flow Setpoint Active (Units: m3/h)'
  • 'Tiong Bahru Plaza, VAV 19-22, Air Flow Setpoint Active (Units: m3/h)'
19
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %).1'
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor humidity (Units: %)'
14
  • 'Tiong Bahru Plaza, DDC-L1-5, AHU-L3-04A trip alarm'
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 Trip Alarm'
20
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC_L4-3, Outdoor temperature (Units: °C).1'
12
  • 'Tiong Bahru Plaza, DDC-L1-5, PAU-L1-06 on/off status'
  • 'Tiong Bahru Plaza, DDC-L20, PAHU TR-1(R-1) ON/OFF STATUS'
39
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Evaporator Refrigerant Pressure - Circuit 1 (Units: Pa)'
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Evaporator Refrigerant Pressure - Circuit 1 (Units: Pa)'
0
  • 'Tiong Bahru Plaza, DDC-L20, Co2 Level 18'
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 CO2 reading'
9
  • 'Tiong Bahru Plaza, DDC-L2-5, PAU-L2-02 supply air temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-02 supply air temperature (Units: °C).2'
18
  • 'Tiong Bahru Plaza, DDC L2-4, AHU L2-04 switch mode'
  • 'Tiong Bahru Plaza, DDC-L3-3, AHU-L3-1 switch mode'
16
  • 'Tiong Bahru Plaza, VAV 19-18, Discharge Air Flow (Units: m3/h)'
  • 'Tiong Bahru Plaza, VAV 19-5, Discharge Air Flow (Units: m3/h)'
8
  • 'Tiong Bahru Plaza, DDC-L1-3, AHU-L1-02 returm air temperature (Units: °C)'
  • 'Tiong Bahru Plaza, DDC-L1-1, AHU-L1-01 returm air temperature (Units: °C)'
3
  • 'Tiong Bahru Plaza, DDC-L20, L20 Fresh air damper control (Units: %)'
  • 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 FAD Control'
28
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CW Flowrate'
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Chilled Water Flow'
10
  • 'Tiong Bahru Plaza, DDC-L4-4, PAU-L4-01 VSD feedback'
  • 'DDC-CH-3:CWP 3 VSD Feedback'
38
  • 'Tiong Bahru Plaza, UC800_102002_Chiller_2, Entering Condenser Water (Units: °C)'
  • 'Tiong Bahru Plaza, UC800_3, Entering Condenser Water (Units: °C)'
43
  • 'Tiong Bahru Plaza, VAV 19-6, Air Valve Position (Units: %).1'
  • 'Tiong Bahru Plaza, VAV 19-11, Air Valve Position (Units: %)'
36
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CWR Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 3 CHWR Temperature'
31
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Head CWR Temp'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWR Temperature'
26
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temp'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWS Temp'
27
  • 'Tiong Bahru Plaza, MB-1-S3, Active Power kW'
  • 'Tiong Bahru Plaza, MB-1-S2, Active Power kW'
37
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CWS Temperature'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Chiller 4 CWS Temperature'
34
  • 'Tiong Bahru Plaza, UC800_101001_Chiller_1, Operating Mode'
  • 'CT 3-1 Switch Mode'
29
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temp'
  • 'Tiong Bahru Plaza, SC-10, Chiller SC, Header CHWR Temperature'
11
  • 'Tiong Bahru Plaza, DDC-L1-4, PAU-L1-05 Start/Stop Control'
  • 'Tiong Bahru Plaza, DDC L14-1, AHU12-1 Start/Stop'
7
  • 'Tiong Bahru Plaza, DDC-L2-2, AHU-L2-05 modulating valve feedback'
  • 'Tiong Bahru Plaza, DDC L4-1, PAU-L4-02 modulating valve feedback (Units: %).3'
22
  • 'Tiong Bahru Plaza, VAV 19-6, Active Setpoint (Units: °C).1'
  • 'Tiong Bahru Plaza, VAV 19-16, Active Setpoint (Units: °C)'
4
  • 'Tiong Bahru Plaza, DDC-L6, AHU 5-3 Flow'
  • 'Tiong Bahru Plaza, DDC-L6, AHU 4-1 Flow'
15
  • 'Tiong Bahru Plaza, VAV 19-17A, Space Temperature (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 19-19, Space Temperature (Units: °C)'
25
  • 'Tiong Bahru Plaza, DDC-L1-3, AHU-L2-02 VSD control'
  • 'Tiong Bahru Plaza, DDC L14-1, AHU 15-1 VSD CONTROL (Units: %)'
23
  • 'Tiong Bahru Plaza, DDC B1-3, Pau-B1-02-DP Sensor'
41
  • ' Chiller SC:Header Differential Pressure'
17
  • 'Tiong Bahru Plaza, VAV 19-15, Discharge Air Temperature (Units: °C)'
  • 'Tiong Bahru Plaza, VAV 19-6, Discharge Air Temperature (Units: °C)'
5
  • 'Tiong Bahru Plaza, DDC-L20, AHU 19-1 OCT (Units: °C)'
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 OCT (Units: °C)'
40
  • 'Wet Bulb Temperature'
33
  • 'Tiong Bahru Plaza, UC800_102004, Cond Water Flow'
  • 'Tiong Bahru Plaza, UC800_102005, Cond Water Flow'
24
  • 'Tiong Bahru Plaza, DDC-L20, PAHU TR-1 TEMPERATURE (Units: °C)'
6
  • 'Tiong Bahru Plaza, DDC-L17, AHU 16-1 Valve Control (Units: %)'
  • 'Tiong Bahru Plaza, DDC-L20, AHU 20-1 VALVE CONTROL (Units: %)'

Evaluation

Metrics

Label Accuracy
all 0.9777

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Varun1010/all-MiniLM-L6-v2-polaris-tiaongBaruPlaza")
# Run inference
preds = model("Tiong Bahru Plaza, DDC-L20, AHU 20-1 VSD CONTROL")

Training Details

Training Set Metrics

Training set Min Median Max
Word count 3 8.6310 12
Label Training Sample Count
0 2
1 2
2 2
3 2
4 2
5 2
6 2
7 2
8 2
9 2
10 2
11 2
12 2
13 2
14 2
15 2
16 2
17 2
18 2
19 2
20 2
21 2
22 2
23 1
24 1
25 2
26 2
27 2
28 2
29 2
30 2
31 2
32 2
33 2
34 2
35 2
36 2
37 2
38 2
39 2
40 1
41 1
42 2
43 2

Training Hyperparameters

  • batch_size: (64, 64)
  • num_epochs: (5, 5)
  • max_steps: -1
  • sampling_strategy: oversampling
  • body_learning_rate: (2e-05, 1e-05)
  • head_learning_rate: 0.01
  • loss: CosineSimilarityLoss
  • distance_metric: cosine_distance
  • margin: 0.25
  • end_to_end: False
  • use_amp: False
  • warmup_proportion: 0.1
  • seed: 42
  • eval_max_steps: -1
  • load_best_model_at_end: False

Training Results

Epoch Step Training Loss Validation Loss
0.0093 1 0.1514 -
0.4630 50 0.0387 -
0.9259 100 0.0369 -
1.3889 150 0.014 -
1.8519 200 0.0161 -
2.3148 250 0.018 -
2.7778 300 0.0181 -
3.2407 350 0.0156 -
3.7037 400 0.0145 -
4.1667 450 0.0186 -
4.6296 500 0.0124 -

Framework Versions

  • Python: 3.10.12
  • SetFit: 1.0.3
  • Sentence Transformers: 2.6.1
  • Transformers: 4.38.2
  • PyTorch: 2.2.1+cu121
  • Datasets: 2.18.0
  • Tokenizers: 0.15.2

Citation

BibTeX 

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
Downloads last month
4
Safetensors
Model size
17.4M params
Tensor type
F32
·

Finetuned from

Evaluation results

View on Papers With Code