---
library_name: setfit
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
base_model: avsolatorio/GIST-all-MiniLM-L6-v2
metrics:
- accuracy
widget:
- text: 'User: My ATM card is not working properly.
Bank Bot: I''m sorry to hear that. Can you please provide me with your account
number and the nature of the issue?
User: My account number is 987654321. I need to pause this conversation for a
few minutes to check my card and provide more information.'
- text: 'User: Hi, I''d like to open a new savings account.
Bank Bot: Great! I can help you with that. To get started, I''ll need some information
from you. Can you confirm your full name, date of birth, and current address?
User: My name is Alex Johnson, my date of birth is September 12th, 1990, and my
current address is 789 Maple Avenue.
Bank Bot: Thank you, Alex. Now, I''ll need to verify your identity. Can you please
provide me with your Social Security Number (SSN) or another form of identification?
User: Actually, my date of birth is incorrect. It''s actually September 15th,
1990.'
- text: 'User: Hello, I''m having trouble with my ATM card.
Bank Bot: I''m sorry to hear that. To assist you further, could you please provide
me with your account number.
User: My account number is 79102374973.
Bank Bot: Do you want new card?
User: No, I don''t want.'
- text: 'User: Hi, I need help with my ATM card.
Bank Bot: Of course. Can you please provide me with your account number and the
issue you''re facing?
User: Well, I tried to withdraw money from an ATM but the transaction was not
successful even though I had sufficient funds.
Bank Bot: I see. Can you please confirm the date and time of the transaction?
User: Actually, I want to restart this conversation. Can we start over?'
- text: 'User: Hi, I want to open a new account. Can you help me?
Bank Assist Bot: Yes, absolutely! What kind of account are you looking for?
User: Before I proceed, I just want to understand the account opening process.
What steps do I need to take?
Bank Assist Bot: Sure, we can provide you an overview of the process. To start,
we will require personal information such as your full name, contact information,
and a valid ID. Then, we will generate and send the account opening documents
to you via email for your review and signature. Once we receive your completed
documents, we will process your request and activate the account within one business
day.
User: Got it, thanks for explaining that. Can I complete the process online.'
pipeline_tag: text-classification
inference: true
model-index:
- name: SetFit with avsolatorio/GIST-all-MiniLM-L6-v2
results:
- task:
type: text-classification
name: Text Classification
dataset:
name: Unknown
type: unknown
split: test
metrics:
- type: accuracy
value: 0.7857142857142857
name: Accuracy
---
# SetFit with avsolatorio/GIST-all-MiniLM-L6-v2
This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [avsolatorio/GIST-all-MiniLM-L6-v2](https://huggingface.co/avsolatorio/GIST-all-MiniLM-L6-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.
## Model Details
### Model Description
- **Model Type:** SetFit
- **Sentence Transformer body:** [avsolatorio/GIST-all-MiniLM-L6-v2](https://huggingface.co/avsolatorio/GIST-all-MiniLM-L6-v2)
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
- **Maximum Sequence Length:** 512 tokens
- **Number of Classes:** 14 classes
### Model Sources
- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
### Model Labels
| Label | Examples |
|:---------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Continue Conversation | - "User: Hi, I want to dispute a transaction on my account.\nBank Bot: Hi there! I'd be happy to assist you with that. Can you please provide me with the details of the transaction you wish to dispute?\nUser: I noticed a charge on my account for $100 that I don't recognize.\nBank Bot: I'm sorry to hear that. Can you please tell me the date the transaction took place and the name of the merchant that charged your account?\nUser: It happened on June 1st and the merchant is called XYZ Company."
- "User: Hi, I want to dispute a transaction on my credit card.\nBot: Of course, I can definitely help you with that. Can you please give me some more details about the transaction?\nUser: Yes, there was a charge on my account for $500 from a company I've never heard of.\nBot: I'm sorry to hear that. Was this charge made in person or online?\nUser: It was made online.\nBot: Okay, can you give me the date of the purchase and the name of the merchant?\nUser: It was on July 1st and the merchant was XYZ Company."
- "User: Hi, I'd like to dispute a transaction on my account.Bank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?User: $100 on March 15th, at a restaurant. However, I don't recall making this transaction.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: No, I have never been there before.\nBank Bot: I'm sorry to hear that. Have you checked with anyone who may have access to your card information, such as a family member or friend?\nUser: Yes, I have checked with my family and friends, but none of them made this transaction.\nBank Bot: I see. In this case, I will need to escalate the issue to our dispute resolution team. Can you please confirm that you did not authorize this transaction?\nUser: Yes, I did not authorize this transaction.\nBank Bot: Great, I will initiate the dispute process for you and send you an update via email within the next 5-7 business days. Is there anything else I can assist you with today?\nUser: No, that's all. Thank you for your help."
|
| Pause Conversation | - "User: Hi, I want to dispute a transaction on my account.\nBank Bot: Hi there! I'd be happy to assist you with that. Can you please provide me with the details of the transaction you wish to dispute?\nUser: I noticed a charge on my account for $100 that I don't recognize.\nBank Bot: I'm sorry to hear that. Can you please tell me the date the transaction took place and the name of the merchant that charged your account?\nUser: It happened on June 1st and the merchant is called XYZ Company.\nBank Bot: Thanks for the information. We'll need to investigate it further. Can you confirm that you did not authorize this transaction?\nUser: Can I pause the conversation for a moment, please?"
- 'User: I need to dispute a transaction on my account.\nBank Bot: Certainly. Can you tell me the date and amount of the transaction please?\nUser: It was on September 15th, for $150.\nBank Bot: Can you confirm it?\nUser: Can we pause this conversation for a moment?\n'
- "User: Hi, I'd like to dispute a transaction on my account.Bank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?User: $100 on March 15th, at a restaurant. However, I don't recall making this transaction.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: Can I pause the conversation for a moment? I need to check my records to see if I can recall anything.\nBank Bot: Sure, take your time.\nUser: Sorry about that. I don't recall making the transaction at that restaurant. Can we take a pause here?\n"
|
| Restart Conversation | - "User: Restart Conversation: The user explicitly requests to start the conversation over from the beginning or discard any conversation till this point. The user may ask directly, 'Can we restart the conversation?' or 'Are we starting over?' explicitly most of the time.\nBank Bot: Hello! How can I assist you today?\nUser: Hi, I need help disputing a transaction.\nBank Bot: I'm sorry to hear that. Can you tell me more about the transaction you want to dispute?\nUser: Yes, I noticed a charge on my account for $100 that I did not authorize.\nBank Bot: I understand. In order to dispute the charge, I will need some more information from you. Can you give me the date of the transaction and the name of the merchant?\nUser: Sure, the date was June 1st and the merchant was XYZ Company.\nBank Bot: Thank you for that information. We will begin an investigation into the transaction and get back to you with our findings within 10 business days.\nUser: Sorry, I've given wrong information can we restart the process?"
- "User: Restart Conversation: The user explicitly requests to start the conversation over from the beginning or discard any conversation till this point. The user may ask directly, 'Can we restart the conversation?' or 'Are we starting over?' explicitly most of the time.\nBank Bot: Hello! How can I assist you today?\nUser: Hi, I need help disputing a transaction.\nBank Bot: I'm sorry to hear that. Can you tell me more about the transaction you want to dispute?\nUser: Yes, I received a product that was defective and I want to dispute the charge.\nBank Bot: I understand. In order to dispute the charge, I will need some more information from you. Can you give me the date of the transaction and the name of the merchant?\nUser: The transaction was on August 15th and the merchant was ABC Company.\nBank Bot: Thank you for that information. We will begin an investigation into the transaction and take the necessary steps to resolve the dispute. Please expect an update from us within 10 business days.\nUser: Okay, I appreciate your assistance. But I'm not sure of the information, can we restart the conversation?"
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Can we start over? I missed the details you asked for earlier.\nBank Bot: Of course. Could you please provide me with the specifics of the transaction you are disputing, including the transaction amount, date, and description?\nUser: $100 on March 15th, at a restaurant. However, I don't recall making this transaction.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: No, I have never been there before.\nBank Bot: I'm sorry to hear that. Have you checked with anyone who may have access to your card information, such as a family member or friend?\nUser: Yes, I have checked with my family and friends, but none of them made this transaction.\nBank Bot: I see. In this case, I will need to escalate the issue to our dispute resolution team. Can you please confirm that you did not authorize this transaction?\nUser: Actually I've lost in process can we restart it?"
|
| Repeat Conversation | - "User: Can you help me dispute a transaction?\nBot: Yeah.\nUser: I noticed a charge on my account for $100 that I don't recognize.\nBank Bot: I'm sorry to hear that. Can you please tell me the date the transaction took place and the name of the merchant that charged your account?\nBank Bot: Sure, I can help you with that. Can you please provide the details of the transaction that you want to dispute?\nUser: Sorry, can you repeat the question? I didn't hear it properly."
- "User: Can you help me dispute a transaction?\nBot: Yeah.\nUser: I noticed a charge on my account for $100 that I don't recognize.\nBank Bot: I'm sorry to hear that. Can you please tell me the date the transaction took place and the name of the merchant that charged your account?\nUser: Sorry, I wasn't paying attention earlier, can you repeat the last question you asked me?"
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Sorry, could you repeat that? I missed the details."
|
| End Conversation | - "User: I need help disputing a transaction.\nBank Bot: Sure, I can help you with that. Can you please provide me with the details of the transaction?\nUser: It was a charge of $50 from a vendor I don't recognize.\nBank Bot: Okay, I will need to verify some information to start the dispute process. Can you please confirm the date and amount of the transaction?\nUser: The transaction was on August 25th for $50.\nBank Bot: Thank you. I will initiate the dispute process and provide you with updates promptly.\nUser: Alright, thanks for your help."
- 'User: I want to dispute a transaction.\nBank Bot: Sure, please provide me with the details of the transaction.\nUser: There was a charge of $75 from a restaurant that I never went to.\nBank Bot: I understand. Can you please provide me with the transaction date and amount?\nUser: The transaction was on September 1st for $75.\nBank Bot: Okay, I have initiated the dispute process. You will receive an update within the next 7 business days.\nUser: Thank you, I appreciate your help.'
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Actually, I changed my mind. I was able to figure it out myself. Thank you for your time."
|
| Refuse to Answer | - "User: I need help disputing a transaction.\nBank Bot: Sure, I can assist you with that. Can you please provide me with the details of the transaction?\nUser: I'm sorry but I cannot disclose such information as it is private."
- "User: My account has been charged for a transaction that I never made.\nBank Bot: I'm sorry to hear that. To help you dispute the transaction, can you please provide me with the details of the transaction?\nUser: I refuse to provide any information as it's my personal data."
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: I'd rather not give that information out.\nBank Bot: I understand your concern. However, in order for us to assist with your dispute, we need the relevant details. Is there anything I can do to ease your concern?\nUser: No, I don't feel comfortable sharing that information."
|
| Affirmative Confirmation | - "User: I want to dispute a transaction.\nBank bot: Sure, I'd be happy to help. Can you tell me the date and amount of the transaction?\nUser: Yes, it was on June 15th for $50.\nBank bot : Are you sure?\nUser : Yes."
- "User: I think there's a problem with a transaction on my account.\nBank bot: I'm sorry to hear that, let's get it resolved. Can you give me the date and amount of the transaction in question?\nUser: It was on July 1st, for $100.\nBank bot: Are you sure about the amount.\nUser: Yes it was $100."
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Yes, my account number is 12937492174.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: No, I have never been there before."
|
| Negative Confirmation | - "User: Hi, I noticed a transaction on my account that I don't recognize. Can you help me with this?\nBank Bot: Sure, I can assist you with that. Can you please provide me with the details of the transaction in question?\nUser: It's a charge for $100 to a website I've never heard of.\nBank Bot: I see. Based on our records, the transaction was processed on the 15th of this month. Are you disputing the transaction?\nUser: No I did not make this transaction."
- "User: Hi there, I need to speak to someone about a problem I'm having with a recent transaction.\nBank Bot: Alright, I'm here to help. What seems to be the issue?\nUser: I received a charge on my account that I don't recognize. Can you tell me what it's for?\nBank Bot: Yes, it looks like the charge is from a restaurant on Main Street for $100. Is that familiar to you?\nUser: No, it's definitely not. I haven't been to Main Street in months."
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Yes, my account number is 12937492174.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: Yes, I eat there all the time.\nBank Bot: I see. It is possible that you may have made this transaction without realizing it. However, just to be sure, have you checked your bank statement to confirm the transaction details?\nUser: Yes, I have checked my statement and I don't see this transaction listed.\nBank Bot: I understand. In this case, I will need to escalate the issue to our dispute resolution team. Did you authorize this transaction?\nUser: No, I did not authorize this transaction."
|
| Correction Request | - 'User: Hi, I need to dispute a transaction.\nBank Bot: Okay, I’m sorry to hear that. Could you please provide some more details about the transaction?\nUser: Yes, I see a charge of $50 that I didn’t make.\nBank Bot: I understand. Could you please confirm the date and the name of the merchant?\nUser: It was on August 15th and the name is XYZ store, but actually, I made a mistake. It was on August 16th, not August 15th.'
- 'User: Hi, I need to dispute a transaction.\nBank Bot: Okay, I’m sorry to hear that. Could you please provide some more details about the transaction?\nUser: Yes, I see a charge of $100 that I didn’t make.\nBank Bot: I understand. Could you please confirm the date and the name of the merchant?\nUser: It was on September 1st and the name is XYZ store, but I made a mistake in the amount. It was actually $150, not $100.'
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Yes, my account number is 12937492174.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: No, I have never been there before.\nBank Bot: I'm sorry to hear that. Have you checked with anyone who may have access to your card information, such as a family member or friend?\nUser: Yes, I have checked with my family and friends, but none of them made this transaction. Actually, I made a mistake earlier. The transaction was for $50, not $100."
|
| Questions Answerable by Conversational Context / History | - "Got it! Here's an example:\nUser: Hi, I need to dispute a transaction.\nBank Bot: Okay, I’m sorry to hear that. Could you please provide some more details about the transaction?\nUser: Yes, I see a charge of $100 that I didn’t make.\nBank Bot: I understand. Could you please confirm the date and the name of the merchant?\nUser: It was on September 1st and the name is XYZ store.\nBank Bot: Thank you for the information. Is there anything else you'd like to add or modify?\nUser: What was the amount of the transaction?"
- "User: Hi, I need to dispute a transaction.\nBank Bot: Okay, I’m sorry to hear that. Could you please provide some more details about the transaction?\nUser: Yes, I see a charge of $100 that I didn’t make.\nBank Bot: I understand. Could you please confirm the date and the name of the merchant?\nUser: It was on September 1st and the name is XYZ store.\nBank Bot: Thank you for the information. Is there anything else you'd like to add or modify?\nUser: When did this transaction occur?"
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Yes, my account number is 12937492174.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: No, I have never been there before.\nBank Bot: I'm sorry to hear that. Have you checked with anyone who may have access to your card information, such as a family member or friend?\nUser: Yes, I have checked with my family and friends, but none of them made this transaction.\nBank Bot: I see. In this case, I will need to escalate the issue to our dispute resolution team. Can you please confirm that you did not authorize this transaction?\nUser: Yes, I did not authorize this transaction.\nBank Bot: Great, I will initiate the dispute process for you and send you an update via email within the next 5-7 business days. Is there anything else I can assist you with today?\nUser: Could you let me know what the dispute process entails?"
|
| Questions Requiring External Information | - "User: Hi, I need to dispute a transaction.\nBank Bot: Okay, I’m sorry to hear that. Could you please provide some more details about the transaction?\nUser: Yes, I see a charge of $100 that I didn’t make.\nBank Bot: I understand. Could you please confirm the date and the name of the merchant?\nUser: It was on September 1st and the name is XYZ store.\nBank Bot: Thank you for the information. Is there anything else you'd like to add or modify?\nUser: Can you provide me with the contact information for the fraud department?"
- "Certainly! Here's another example:\nUser: Hi, I need to dispute a transaction.\nBank Bot: Okay, I’m sorry to hear that. Could you please provide some more details about the transaction?\nUser: Yes, I see a charge of $200 that I didn’t make.\nBank Bot: I understand. Could you please confirm the date and the name of the merchant?\nUser: It was on September 5th and the name is ABC Electronics.\nBank Bot: Thank you for the information. Is there anything else you'd like to add or modify?\nUser: Can you provide me with the status of my recent deposit?"
- "User: Hi, I need to dispute a transaction.\nBank Bot: I'm sorry to hear that. Can you please provide me with the details of the transaction.\nUser: I see a charge of $150 that I didn’t authorize.\nBank Bot: I understand. Can you confirm the date and the name of the merchant?\nUser: It was on September 10th and the merchant is XYZ Clothing Store.\nBank Bot: Thank you. Is there anything else you'd like to add or modify?\nUser: No, that's all I want to added.\nBank Bot: Is there aything else you need to know?\nUser: Can you provide me with the current balance of my account?"
|
| Questions on Process | - 'User: Can you please explain the process for disputing a transaction?\nBank Bot: Absolutely. First, you need to report the transaction as unauthorized or fraudulent within 60 days of the date it appeared on your statement. Then, we will investigate the issue and work with you to resolve it.\nUser: What kind of information do I need to provide during the investigation?\nBank Bot: You will need to provide documentation proving that you did not make the transaction, such as a police report or signed affidavit. In some cases, we may also need additional information about the transaction in question.\nUser: How long does the investigation typically take?'
- "User: Hi, I need to dispute a transaction on my account.\nBank Bot: Hello, I'd be happy to help you with that. Can you please provide me with some more information about the transaction you are disputing?\nUser: Sure, it was for a purchase I never made.\nBank Bot: I apologize for any inconvenience this may have caused you. Before we move forward with the dispute process, can I ask if you have attempted to resolve the issue with the merchant directly?\nUser: Yes, I have reached out to the merchant, but they have been unresponsive.\nBank Bot: Understood. Now, I'll need to ask you a few more questions to initiate the dispute process. Can you please confirm the date and amount of the transaction?\nUser: The transaction was for $100 and it occurred on June 1st.\nBank Bot: Thank you for that information. I have initiated the dispute process and you will receive a response from us within 10 business days. Is there anything else I can assist you with?\nUser: Actually, I have a question about the dispute process. Can you explain to me how it works?"
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Yes, my account number is 12937492174.\nBank Bot: Thank you for providing the details. Based on your information, I can see that the transaction was made at a restaurant. Do you often dine at this particular restaurant?\nUser: No, I have never been there before.\nBank Bot: I'm sorry to hear that. Have you checked with anyone who may have access to your card information, such as a family member or friend?\nUser: Yes, I have checked with my family and friends, but none of them made this transaction.\nBank Bot: I see. In this case, I will need to escalate the issue to our dispute resolution team. Can you please confirm that you did not authorize this transaction?\nUser: Yes, I did not authorize this transaction. Can you tell me more about how the dispute resolution team works?"
|
| New Inquiry or Request | - "User: Hi there! I need some assistance with disputing a transaction.\nBank Bot: Hello! I can assist you with that. Can you provide me with some details about the transaction you'd like to dispute?\nUser: Yes, I recently made a purchase and I noticed that I was charged twice for the same item.\nBank Bot: I see. Can you provide me with the date and amount of the transaction?\nUser: Sure, the transaction was made on June 10th and the amount was $50.\nBank Bot: Thank you for the information. I will start the dispute process for you. Is there anything else I can assist you with?\nUser : Can you tell me how much did you charged for this?"
- "User: Hi, I have a question about disputing a transaction on my account.\nBank Bot: Hello! I'm happy to help. Please provide me with some details about the transaction in question.\nUser: I received a product that was damaged, but the merchant has refused to issue a refund. What can I do?\nBank Bot: I'm sorry to hear that. Have you tried contacting the merchant to resolve the issue?\nUser: Yes, but they are not being cooperative. Can you help me dispute the transaction?"
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: Actually, before we proceed with the dispute, I have a question. Is it possible to get a lower interest rate on my credit card?"
|
| Transfer to Human Agent | - "User: Hi, I want to dispute a transaction on my account.\nBank Bot: Hi there! I'd be happy to assist you with that. Can you please provide me with the details of the transaction you wish to dispute?\nUser: I noticed a charge on my account for $100 that I don't recognize.\nBank Bot: I'm sorry to hear that. Can you please tell me the date the transaction took place and the name of the merchant that charged your account?\nUser: It happened on June 1st and the merchant is called XYZ Company.\nBank Bot: Thanks for the information. We'll need to investigate it further. Can you confirm that you did not authorize this transaction?\nUser: Transfer to a human agent please."
- "User: Hi, I want to dispute a transaction on my account.\nBank Bot: Hi there! I'd be happy to assist you with that. Can you please provide me with the details of the transaction you wish to dispute?\nUser: I noticed a charge on my account for $100 that I don't recognize.\nBank Bot: I'm sorry to hear that. Can you please tell me the date the transaction took place and the name of the merchant that charged your account?\nUser: It happened on June 1st and the merchant is called XYZ Company.\nBank Bot: Thanks for the information. We'll need to investigate it further. Can you confirm that you did not authorize this transaction?\nUser: Yes, I did not authorize this transaction. Get me a human agent."
- "User: Hi, I'd like to dispute a transaction on my account.\nBank Bot: I'm sorry to hear that. To assist you further, could you please provide me with the details of the transaction you wish to dispute, including the transaction amount, date, and description?\nUser: I've already provided that information. Can I please speak with a human agent about this?"
|
## Evaluation
### Metrics
| Label | Accuracy |
|:--------|:---------|
| **all** | 0.7857 |
## Uses
### Direct Use for Inference
First install the SetFit library:
```bash
pip install setfit
```
Then you can load this model and run inference.
```python
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("setfit_model_id")
# Run inference
preds = model("User: Hello, I'm having trouble with my ATM card.
Bank Bot: I'm sorry to hear that. To assist you further, could you please provide me with your account number.
User: My account number is 79102374973.
Bank Bot: Do you want new card?
User: No, I don't want.")
```
## Training Details
### Training Set Metrics
| Training set | Min | Median | Max |
|:-------------|:----|:---------|:----|
| Word count | 38 | 101.8714 | 213 |
| Label | Training Sample Count |
|:---------------------------------------------------------|:----------------------|
| Affirmative Confirmation | 5 |
| Continue Conversation | 5 |
| Correction Request | 5 |
| End Conversation | 5 |
| Negative Confirmation | 5 |
| New Inquiry or Request | 5 |
| Pause Conversation | 5 |
| Questions Answerable by Conversational Context / History | 5 |
| Questions Requiring External Information | 5 |
| Questions on Process | 5 |
| Refuse to Answer | 5 |
| Repeat Conversation | 5 |
| Restart Conversation | 5 |
| Transfer to Human Agent | 5 |
### Training Hyperparameters
- batch_size: (12, 12)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- body_learning_rate: (2e-05, 1e-05)
- head_learning_rate: 0.01
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False
### Training Results
| Epoch | Step | Training Loss | Validation Loss |
|:------:|:----:|:-------------:|:---------------:|
| 0.0026 | 1 | 0.4165 | - |
| 0.1316 | 50 | 0.1331 | - |
| 0.2632 | 100 | 0.1058 | - |
| 0.3947 | 150 | 0.0244 | - |
| 0.5263 | 200 | 0.019 | - |
| 0.6579 | 250 | 0.0119 | - |
| 0.7895 | 300 | 0.0641 | - |
| 0.9211 | 350 | 0.0241 | - |
### Framework Versions
- Python: 3.10.12
- SetFit: 1.0.3
- Sentence Transformers: 2.7.0
- Transformers: 4.40.1
- PyTorch: 2.2.1+cu121
- Datasets: 2.19.0
- Tokenizers: 0.19.1
## Citation
### BibTeX
```bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
```