SetFit with sentence-transformers/paraphrase-mpnet-base-v2
This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
- Fine-tuning a Sentence Transformer with contrastive learning.
- Training a classification head with features from the fine-tuned Sentence Transformer.
Model Details
Model Description
- Model Type: SetFit
- Sentence Transformer body: sentence-transformers/paraphrase-mpnet-base-v2
- Classification head: a LogisticRegression instance
- Maximum Sequence Length: 512 tokens
- Number of Classes: 135 classes
Model Sources
- Repository: SetFit on GitHub
- Paper: Efficient Few-Shot Learning Without Prompts
- Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts
Model Labels
Label | Examples |
---|---|
Remittance To India |
|
Executive Director’s Profile |
|
INDIAN BANK MUTUAL FUND |
|
IND MSME VEHICLE |
|
Awards & Accolades |
|
Supply Chain Finance |
|
Merchant UPI QR Code |
|
Loan/OD against Deposit |
|
Re-KYC: Periodic Update of KYC Details |
|
IND SUPER 400 DAYS |
|
Centralized Pension Processing Centre |
|
CA FOR STATE /CENTRAL GOVT & CONSULAR & IND PFMS |
|
Indian Bank, IFSC Banking Unit, GIFT City |
|
F.A.Qs |
|
IND GST ADVANTAGE |
|
Digitizing the Indian Banking Experience |
|
Terms and Conditions Indian Bank Digital Rupee |
|
National Common Mobility Card (NCMC) |
|
IMAGE |
|
IndSMART: Indian Bank’s Omni channel Mobile App |
|
Disclaimer |
|
Term Deposits |
|
Interest Rates for Small Savings Schemes |
|
NRI and Forex |
|
Azadi Ka Amrit Mahotsav #TogetherforBiggerThings |
|
IB MSME Jewel Loan |
|
IB Golden Ager Term Deposit Product for Super Senior Citizens |
|
What is a Credit Score and How it Shapes Financial Health |
|
IMPORTANT TERMS AND CONDITIONS CA |
|
Credit Cards |
|
Managing Director & CEO’s Profile |
|
Jewel Loan |
|
Corporate Social Responsibility |
|
Scheme on financing Manufacturers / Suppliers / Vendors of Solar panels and other ancillary products |
|
Board of Directors |
|
Quick Contact |
|
Vision and Mission |
|
Corporate |
|
Service Charges / Forex Rates |
|
Welfare of Minorities |
|
Bancassurance |
|
IND PM Vishwakarma |
|
IB Tax Saver Scheme |
|
Weaver MUDRA |
|
Chief Vigilance Officer |
|
Careers |
|
Press Releases |
|
Online Collection Products |
|
IND-SURYA SHAKTI |
|
IND-SME EASE |
|
e-Allahabad Bank Journey |
|
IndSMART |
|
Fixed Deposit |
|
Scheme for financing MSMEs for setting up Biomass Pellets manufacturing units |
|
TERMS AND CONDITIONS-TERM DEPOSIT ACCOUNT |
|
IND SME Secure |
|
Investor Relations |
|
Ind Advantage (Reward Program) |
|
Welcome aboard! |
|
Deposit Rates |
|
Loyalty Program Delights: Unlocking Special Rewards for Your Loyalty |
|
NETC FASTag |
|
IB Tradewell |
|
PM Surya Ghar: Muft Bijli Yojna |
|
IND SUPREME 300 DAYS |
|
Sukanya Samriddhi Account |
|
IND NAVYA |
|
Short Term Deposits |
|
Block Lost ATM Card |
|
MSME DIGI Jewel Loan and Jewel Loan (Re-Pledge) |
|
Nodal Officers- Customer service |
|
MSME AUTO RENEWAL |
|
IB COMFORT- DOMESTIC AND NRE |
|
LOAN AGAINST LEASE RENTALS |
|
IB HARIT |
|
SMS Banking/ Missed Call Service |
|
MSME LAP |
|
Head Office Departments |
|
Current Account |
|
IND COURT |
|
Amalgamation |
|
IND Professional Special |
|
Foreign Branches |
|
Regulatory Disclosures Section |
|
N R I / Foreign Exchange |
|
NRI A/cs |
|
Reverse Mortgage |
|
Block Lost Credit Card |
|
Death Claim Settlement |
|
Online Loans |
|
Service Charges |
|
Notifications |
|
Corporate Blog |
|
Premium Current Account |
|
Pre Approved Business Loan |
|
Doorstep Banking |
|
Point of Sale (PoS) |
|
ATM / Debit Cards |
|
BHIM Aadhaar Pay |
|
Capital Gains |
|
Indian Bank Financial Results |
|
Customer Centric Services |
|
Positive Pay System (PPS) |
|
Motor Accident Claim Tribunal Deposit(MACAD) Scheme |
|
IND HEALTH CARE |
|
Loan / OD against NSC / KVP / Relief bonds of RBI / LIC policies |
|
Lab Grown Diamond Scheme |
|
IB RERA Current Account |
|
IND EQUIPMENT & WHEELS (CE/CV) scheme |
|
IMAGE Email Id’s |
|
General Managers |
|
Money multiplier Deposits |
|
IB Loan against Sovereign Gold Bond |
|
Branch ATM |
|
Financial Inclusion in India: Filling the Void |
|
Jaffna Branch |
|
Financial Inclusion |
|
Featured Products / Services / Schemes |
|
Another Option for Pension |
|
Bank’s Profile |
|
SHISHU MUDRA |
|
e Payment of Indirect Taxes |
|
IND Non-Callable Deposit |
|
Services rendered free of charge |
|
Debit Cards |
|
Chief General Managers |
|
Colombo Branch |
|
Ind Mortgage |
|
Recurring Deposit |
|
e Payment of Direct Taxes |
|
Lending rates |
|
Entity: Internet banking |
|
Customer Complaints / Awareness |
|
IND-SME E-VAAHAN |
|
Variable Recurring Deposit |
|
Evaluation
Metrics
Label | Accuracy |
---|---|
all | 0.9352 |
Uses
Direct Use for Inference
First install the SetFit library:
pip install setfit
Then you can load this model and run inference.
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("kneau007/my-classifier-2")
# Run inference
preds = model("\"Current account disaster relief funding?\"")
Training Details
Training Set Metrics
Training set | Min | Median | Max |
---|---|---|---|
Word count | 3 | 5.5968 | 11 |
Label | Training Sample Count |
---|---|
Corporate Blog | 11 |
Doorstep Banking | 17 |
ATM / Debit Cards | 15 |
Amalgamation | 17 |
Another Option for Pension | 17 |
Awards & Accolades | 18 |
Azadi Ka Amrit Mahotsav #TogetherforBiggerThings | 16 |
BHIM Aadhaar Pay | 12 |
Bancassurance | 17 |
Bank’s Profile | 16 |
Block Lost ATM Card | 16 |
Block Lost Credit Card | 17 |
Board of Directors | 15 |
Branch ATM | 14 |
CA FOR STATE /CENTRAL GOVT & CONSULAR & IND PFMS | 18 |
Capital Gains | 18 |
Careers | 15 |
Chief General Managers | 16 |
Chief Vigilance Officer | 19 |
Colombo Branch | 16 |
Corporate | 15 |
Corporate Social Responsibility | 17 |
Credit Cards | 19 |
Current Account | 16 |
Customer Centric Services | 15 |
Customer Complaints / Awareness | 13 |
Death Claim Settlement | 17 |
Debit Cards | 17 |
Deposit Rates | 12 |
Digitizing the Indian Banking Experience | 17 |
Disclaimer | 16 |
Entity: Internet banking | 15 |
Executive Director’s Profile | 17 |
F.A.Qs | 15 |
Featured Products / Services / Schemes | 16 |
Financial Inclusion | 15 |
Financial Inclusion in India: Filling the Void | 16 |
Fixed Deposit | 16 |
Foreign Branches | 15 |
General Managers | 16 |
Head Office Departments | 16 |
IB COMFORT- DOMESTIC AND NRE | 14 |
IB Golden Ager Term Deposit Product for Super Senior Citizens | 18 |
IB HARIT | 15 |
IB Loan against Sovereign Gold Bond | 16 |
IB MSME Jewel Loan | 13 |
IB Tax Saver Scheme | 18 |
IB Tradewell | 17 |
IMAGE | 18 |
IMAGE Email Id’s | 17 |
IMPORTANT TERMS AND CONDITIONS CA | 16 |
IND COURT | 17 |
IND EQUIPMENT & WHEELS (CE/CV) scheme | 12 |
IND HEALTH CARE | 17 |
IND MSME VEHICLE | 17 |
IND NAVYA | 17 |
IND Non-Callable Deposit | 14 |
IND Professional Special | 17 |
IND SME Secure | 18 |
IND SUPER 400 DAYS | 13 |
IND SUPREME 300 DAYS | 18 |
IND-SME E-VAAHAN | 15 |
IND-SME EASE | 12 |
IND-SURYA SHAKTI | 14 |
INDIAN BANK MUTUAL FUND | 18 |
Ind Advantage (Reward Program) | 17 |
Ind Mortgage | 14 |
IndSMART | 15 |
IndSMART: Indian Bank’s Omni channel Mobile App | 14 |
Indian Bank Financial Results | 18 |
Indian Bank, IFSC Banking Unit, GIFT City | 17 |
Interest Rates for Small Savings Schemes | 18 |
Investor Relations | 17 |
Jaffna Branch | 18 |
Jewel Loan | 17 |
LOAN AGAINST LEASE RENTALS | 14 |
Lab Grown Diamond Scheme | 14 |
Lending rates | 17 |
Loan / OD against NSC / KVP / Relief bonds of RBI / LIC policies | 20 |
Loan/OD against Deposit | 15 |
MSME AUTO RENEWAL | 19 |
MSME DIGI Jewel Loan and Jewel Loan (Re-Pledge) | 16 |
MSME LAP | 18 |
Managing Director & CEO’s Profile | 17 |
Merchant UPI QR Code | 14 |
Money multiplier Deposits | 14 |
Motor Accident Claim Tribunal Deposit(MACAD) Scheme | 14 |
N R I / Foreign Exchange | 14 |
NETC FASTag | 17 |
NRI A/cs | 17 |
NRI and Forex | 15 |
National Common Mobility Card (NCMC) | 16 |
Nodal Officers- Customer service | 16 |
Notifications | 16 |
Online Collection Products | 12 |
Online Loans | 15 |
PM Surya Ghar: Muft Bijli Yojna | 19 |
Point of Sale (PoS) | 17 |
Positive Pay System (PPS) | 15 |
Pre Approved Business Loan | 16 |
Premium Current Account | 18 |
Press Releases | 16 |
Quick Contact | 14 |
Re-KYC: Periodic Update of KYC Details | 17 |
Recurring Deposit | 17 |
Regulatory Disclosures Section | 15 |
Remittance To India | 14 |
Reverse Mortgage | 16 |
SHISHU MUDRA | 19 |
SMS Banking/ Missed Call Service | 15 |
Scheme for financing MSMEs for setting up Biomass Pellets manufacturing units | 15 |
Scheme on financing Manufacturers / Suppliers / Vendors of Solar panels and other ancillary products | 15 |
Service Charges | 19 |
Service Charges / Forex Rates | 16 |
Services rendered free of charge | 17 |
Short Term Deposits | 16 |
Sukanya Samriddhi Account | 13 |
Supply Chain Finance | 15 |
TERMS AND CONDITIONS-TERM DEPOSIT ACCOUNT | 18 |
Term Deposits | 16 |
Terms and Conditions Indian Bank Digital Rupee | 17 |
Variable Recurring Deposit | 16 |
Vision and Mission | 16 |
Weaver MUDRA | 18 |
Welcome aboard! | 16 |
Welfare of Minorities | 15 |
What is a Credit Score and How it Shapes Financial Health | 18 |
e Payment of Direct Taxes | 14 |
e Payment of Indirect Taxes | 17 |
e-Allahabad Bank Journey | 13 |
Centralized Pension Processing Centre | 15 |
IB RERA Current Account | 19 |
IND GST ADVANTAGE | 16 |
IND PM Vishwakarma | 15 |
Loyalty Program Delights: Unlocking Special Rewards for Your Loyalty | 18 |
Training Hyperparameters
- batch_size: (16, 16)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- num_iterations: 20
- body_learning_rate: (2e-05, 2e-05)
- head_learning_rate: 2e-05
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- l2_weight: 0.01
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False
Training Results
Epoch | Step | Training Loss | Validation Loss |
---|---|---|---|
0.0002 | 1 | 0.1566 | - |
0.0093 | 50 | 0.146 | - |
0.0185 | 100 | 0.1398 | - |
0.0278 | 150 | 0.1027 | - |
0.0371 | 200 | 0.0887 | - |
0.0463 | 250 | 0.071 | - |
0.0556 | 300 | 0.0644 | - |
0.0649 | 350 | 0.0492 | - |
0.0741 | 400 | 0.05 | - |
0.0834 | 450 | 0.0464 | - |
0.0927 | 500 | 0.0325 | - |
0.1019 | 550 | 0.0312 | - |
0.1112 | 600 | 0.033 | - |
0.1205 | 650 | 0.0266 | - |
0.1297 | 700 | 0.0225 | - |
0.1390 | 750 | 0.0206 | - |
0.1483 | 800 | 0.0188 | - |
0.1576 | 850 | 0.0229 | - |
0.1668 | 900 | 0.0164 | - |
0.1761 | 950 | 0.0168 | - |
0.1854 | 1000 | 0.0159 | - |
0.1946 | 1050 | 0.0131 | - |
0.2039 | 1100 | 0.0122 | - |
0.2132 | 1150 | 0.0098 | - |
0.2224 | 1200 | 0.0093 | - |
0.2317 | 1250 | 0.0159 | - |
0.2410 | 1300 | 0.0104 | - |
0.2502 | 1350 | 0.014 | - |
0.2595 | 1400 | 0.0074 | - |
0.2688 | 1450 | 0.0089 | - |
0.2780 | 1500 | 0.0176 | - |
0.2873 | 1550 | 0.0118 | - |
0.2966 | 1600 | 0.0068 | - |
0.3058 | 1650 | 0.0105 | - |
0.3151 | 1700 | 0.0076 | - |
0.3244 | 1750 | 0.0122 | - |
0.3336 | 1800 | 0.0134 | - |
0.3429 | 1850 | 0.0088 | - |
0.3522 | 1900 | 0.0134 | - |
0.3614 | 1950 | 0.0052 | - |
0.3707 | 2000 | 0.0074 | - |
0.3800 | 2050 | 0.0069 | - |
0.3892 | 2100 | 0.0056 | - |
0.3985 | 2150 | 0.0059 | - |
0.4078 | 2200 | 0.0064 | - |
0.4171 | 2250 | 0.0075 | - |
0.4263 | 2300 | 0.0064 | - |
0.4356 | 2350 | 0.0042 | - |
0.4449 | 2400 | 0.0053 | - |
0.4541 | 2450 | 0.0061 | - |
0.4634 | 2500 | 0.0062 | - |
0.4727 | 2550 | 0.0076 | - |
0.4819 | 2600 | 0.004 | - |
0.4912 | 2650 | 0.009 | - |
0.5005 | 2700 | 0.0096 | - |
0.5097 | 2750 | 0.0066 | - |
0.5190 | 2800 | 0.0084 | - |
0.5283 | 2850 | 0.0052 | - |
0.5375 | 2900 | 0.0079 | - |
0.5468 | 2950 | 0.005 | - |
0.5561 | 3000 | 0.0053 | - |
0.5653 | 3050 | 0.0055 | - |
0.5746 | 3100 | 0.0049 | - |
0.5839 | 3150 | 0.0066 | - |
0.5931 | 3200 | 0.0074 | - |
0.6024 | 3250 | 0.0063 | - |
0.6117 | 3300 | 0.0039 | - |
0.6209 | 3350 | 0.0042 | - |
0.6302 | 3400 | 0.0072 | - |
0.6395 | 3450 | 0.0047 | - |
0.6487 | 3500 | 0.0037 | - |
0.6580 | 3550 | 0.0048 | - |
0.6673 | 3600 | 0.0034 | - |
0.6766 | 3650 | 0.0067 | - |
0.6858 | 3700 | 0.0049 | - |
0.6951 | 3750 | 0.0048 | - |
0.7044 | 3800 | 0.0041 | - |
0.7136 | 3850 | 0.0088 | - |
0.7229 | 3900 | 0.0035 | - |
0.7322 | 3950 | 0.0047 | - |
0.7414 | 4000 | 0.005 | - |
0.7507 | 4050 | 0.0047 | - |
0.7600 | 4100 | 0.0051 | - |
0.7692 | 4150 | 0.0035 | - |
0.7785 | 4200 | 0.0043 | - |
0.7878 | 4250 | 0.0062 | - |
0.7970 | 4300 | 0.0029 | - |
0.8063 | 4350 | 0.0076 | - |
0.8156 | 4400 | 0.0027 | - |
0.8248 | 4450 | 0.0026 | - |
0.8341 | 4500 | 0.0037 | - |
0.8434 | 4550 | 0.0069 | - |
0.8526 | 4600 | 0.0037 | - |
0.8619 | 4650 | 0.0027 | - |
0.8712 | 4700 | 0.0025 | - |
0.8804 | 4750 | 0.0024 | - |
0.8897 | 4800 | 0.0076 | - |
0.8990 | 4850 | 0.0036 | - |
0.9082 | 4900 | 0.0028 | - |
0.9175 | 4950 | 0.0027 | - |
0.9268 | 5000 | 0.0028 | - |
0.9361 | 5050 | 0.005 | - |
0.9453 | 5100 | 0.0041 | - |
0.9546 | 5150 | 0.0042 | - |
0.9639 | 5200 | 0.004 | - |
0.9731 | 5250 | 0.0027 | - |
0.9824 | 5300 | 0.0049 | - |
0.9917 | 5350 | 0.0044 | - |
Framework Versions
- Python: 3.11.11
- SetFit: 1.1.1
- Sentence Transformers: 3.4.1
- Transformers: 4.48.3
- PyTorch: 2.6.0+cu124
- Datasets: 3.4.0
- Tokenizers: 0.21.0
Citation
BibTeX
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.