--- library_name: setfit tags: - setfit - sentence-transformers - text-classification - generated_from_setfit_trainer base_model: sentence-transformers/all-MiniLM-L6-v2 metrics: - accuracy widget: - text: "James\n\n\nFrom: The Desk of Ajibola James\nSenior Manager: Pacific International\ \ Bank PLC.\n 40 Marina Street\n Lagos\n\nDear friend,\n\ \nFirst, I must solicit your confidence in this transaction. This is by virtue\ \ \nof its nature being utterly confidential and top secret. We have decided\ \ to \ncontact you due to the urgency of this transaction, as we have been reliably\ \ \ninformed of your discretness, trustworthy and ability to carry out legitimate\ \ \nbusiness.\n\nTHE PROPOSITION: An American, Mr. Shaline Adam, an Oil merchant\ \ with the \nFederal Government of Nigeria, until his death with his whole family\ \ on an \nEgyptAir Flight #990, which crashed into the Atlantic Ocean on October\ \ 31, \n1999, banked with us at Pacific International Bank Plc Lagos and had\ \ a \nclosing balance of US$3.5,000,000.00 (Three Milion Five Hundred Thousand\ \ \nUnited States Dollars Only) as at the end of September, 2000. Attached here\ \ \nis a CNN webpage on the unfortunate crash in 1999: \nhttp://www.cnn.com/US/9911/02/egyptair990.list/index.html\n\ \nValuable efforts have been made by the bank to get in touch with any of the\ \ \nAdam's family or relative, but to no avail. His Next of Kin was his wife that\ \ \nwas involved in the crash so for now there is no trace of his family.\n\n\ It is because of the perceived impossibility of locating a relative of the \n\ Shaline Adam's family (since all his family are dead) that the bank is making\ \ \nplans to ceed the said amount to the Defence Ministry for the procurement\ \ of \nweapons of war. In order to avert this ugly situation, few of my colleagues\ \ \nand I have decided to contact you and seek your permission to have you stand\ \ \nas a relative to Late Shaline Adam so that the total amount of US$3.5 Million\ \ \nDollars will be processed and released in your favour into your personal \n\ account.\n\nAll documents and proofs to enable you get this fund will be carefully\ \ \nworked out. We have secured from the probate, an order of Madamus, to locate\ \ \nany of the deceased beneficiary. Be rest assured that this transaction is\ \ \nrisk-free. Also, your share for offering to assist us and provide the \nreceiving\ \ account will be 10% of the total sum, while 90% will be for my \ncolleagues\ \ and I, which also would be in your account for safe custody and \nprobable future\ \ investment purpose in your country.\n\nAs soon as we receive an acknowledgement\ \ of your willingness to accept our \nproposal, we shall furnish you with further\ \ details as we concluded all \narrangements to have the money transferred to\ \ you within 7 working days from \nthe date of commencement.\n\nIf this proposal\ \ is acceptable to you, then furnish us with your most \nconfidential telephone\ \ and fax numbers at which time an application for the \nfund release will\ \ be forwarded in your favour.\n\nThank you in advance for your anticipated cooperation.\n\ \nRegards,\n\nAjibola James\n\nAlternative mail:jrade2000@caramail.com" - text: "My Compliment\n\n\nFrom: Dr. Rasheed S. Abubakar,\n\nDear Friend,\n\nMy Compliment\ \ to you,\n\nI guess this letter may come to you as a surprise since I had no\ \ \nprevious correspondence with you.\n\nI am sending you this mail on behalf\ \ of the chairman tender board of \nIndependent National Electoral Commission\ \ (INEC) MR. SETTLEY DAZE. We \ngot your contact in our search for a reliable\ \ person to handle a very \nconfidential transaction involving the transfer of\ \ Forty Nine Million, \nFive Hundred Thosand United States Dollars US$49.5Million.\n\ \nThe above fund is not connected with arms, drugs or money laundering. \nIt is\ \ the product of an over invoiced Contract awarded in 2001 by INEC \nto a foreign\ \ company for the construction of high rise estate in the \nfederal capital territory.\n\ \nThe contract has long been executed and payment of the actual contract \namount\ \ has been paid to the foreign contractor leaving the balance, \nwhich my colleague\ \ and I now want to transfer out of Nigeria into a \nreliable foreign account\ \ for our personal use.\n\nAs civil servants we are not allowed to run foreign\ \ accounts. Hence we \nhave chosen you to front and support us as the beneficiary\ \ to be paid. \nIf you are interested in the proposal kindly get back to me by\ \ sending \nme your letter of acceptance along with your direct telephone and\ \ fax \nnumbers, For your support and partnership, please reply me to negotiate\ \ \nyour fees or the percentage you wish to be paid when the funds arrive \nyour\ \ bank account. \n\nFurther details about this transaction will be discussed in\ \ the \nsubsequent correspondence. Note also that the particular nature of your\ \ \nbusiness is irrelevant to this transaction and all local contacts and \narrangements\ \ are in place for a smooth and successful conclusion of \nthis transaction.\n\ \nBe informed that we are aware of the way email proposals of this type \nare\ \ being sent from this part of africa and as regards that, you should \nplease\ \ treat this with utmost attention knowing fully well that you \ncannot and will\ \ not be compelled to assist us if you are not disposed \nto.\n\nContact me via\ \ my email account or you also reach me on this email \naccount she_rashabubakar@yahoo.com\ \ with your contact telephone and fax \nnumbers on response, I will call you for\ \ a discussion.\n\nThank you as I await your response.\n\nSincerely,\n\n\nDr.\ \ Rasheed S. Abubakar." - text: 'How to resolve! www.rewire.comInternational Financial Services - RewireInternational Financial Services - RewireGood Day YvonneOpen the attach file sent ,after the departmental payment receipt has be uploaded we also sent awareness letter note to Mr chalan which should be sent to your bank directly by chalan,Please ensure chalan uploads the departmental payment receipt receipt as soon as possible because the amount to your account is more than $100,000 when converted from pound sterling to USD,please write him (chalan)as soon as possible to settle thisKind RegardsReire Paying Deptwww.rewire.com' - text: "Introduction/Business Proposal\n\n\nMy Dear Friend , \nGREETING!!!.With a\ \ humbled heart I commit myself this day to write \nand ask for your benevolence\ \ and kind consideration of \nmy families plight for assistance. I am making this\ \ contact on behalf of my\n family not minding the consequences but hoping that\ \ you would understand our\n predicament and come to our aid and assist us. I\ \ would also kindly apologize\n for any inconvenience or embarrassment this might\ \ cause your person, as we\n neither know each other personally nor have had any\ \ previous contact or\n correspondence. \nI am Julius Nsekou Mobutu Sese Sekou,son\ \ of the late president Mobutu Sese Sekou\n of the Congo Democratic Republic(former\ \ Republic of Zaire). \nThere was unrest (war) in my country which resulted in\ \ the overthrow and\n eventual of my father President \nMobutu Sese Sekou.My family\ \ members have since escaped \nto Morocco while i am presently in Nigeria(West\ \ Africa) on political asylum. \nDue to the political crisis,no member of my family\ \ can go back to the Congo\n Democratic Republic or transact any business investment\ \ there,also my fathers\n properties have been seized and Bank accounts frozen\ \ by the Government of\n Lawrent Joseph Kabila. \nBefore my father died ,he deposited\ \ the sum of $50.5 MILLION(USD) CASH in a\n PRIVATE SECURITY VAULT in Europe.Please\ \ we need your assistance in moving and\n securing this money in your bank accounts\ \ abroad,my family will compensate you\n adequately with 20% of the total amount\ \ for your assistance and co operation. \nMy family will want to invest this money\ \ abroad,and for this reason, i sincerely\n appeal to you to help us in setting\ \ up this business.May i also state that you\n will advice on areas of investment\ \ as regards your business and your country as\n the families foreign partner.\ \ \nI look forward to further co-operation from you and will be grateful for your\n\ \ immediate response through the underlisted mediums. \nReply back to E-mail:\ \ sekou_family@fsmail.net\nYours Sincerely, \nJulius Nsekou Mobutu & Entire Family." - text: "FAMILY BUSINESS ASSISTANCE\n\n\nHIGHLY CONFIDENTIAL\nFROM: Prince Tunde O\ \ Adisaraki \nMOBILE:234-90-509398\nMOBILE:234-80-33254029\nFAX:234-92726808\n\ \ \n \nGreetings, \n \nThis letter might surprise you because we have not met\ \ neither in person nor by correspondence. But I believe it is one day that you\ \ get to know somebody either in physical or through correspondence. I got your\ \ contact through some discreet inquiry from the chamber of commerce and industry,\ \ you and your organization were revealed as being quite astute in private entrepreneurship,\ \ one has no doubt in your ability to handle a financial business transaction.\n\ \ \nHowever,I am the first son of his Royal Majesty, Iginawari Nweke Adisaraki\ \ III and the traditional ruler of Eleme Province in the oil area of Rivers State\ \ of Nigeria. I am making this contact to you in respect of US 28,000,000.00 (Twenty\ \ eight million United States Dollars) which I inherited from my late father.\ \ This money was accumulated from royalties paid to my father as compensation\ \ by the oil firms located in our area as a result of oil presence on our land\ \ which hamper agriculture which is our major source of livelihood. Unfortunately\ \ my father died from protracted diabetes. But before his he called my attention\ \ and informed me that he lodged some funds on a two boxes with a security firm\ \ with an open beneficiary status. The lodgment Security Code Number was also\ \ revealed to me, he then advised me to look for a reliable business partner abroad,\ \ who will assist me in investing the money in a lucrative business as a result\ \ of economic instability in Nigeria.\n \nSo this is the main reason why I am\ \ contacting you for us to move this money from the security firm to any country\ \ of your choice for investment purposes. So I will like you to be the ultimate\ \ beneficiary, so that the funds can be moved in your name and particulars to\ \ any country of your choice where it will be claimed and invested. Hence my father\ \ have had intimated the security firm personnel that the beneficiary of the Box\ \ is his foreign partner whose particulars will be forwarded to the firm when\ \ due. \n \nBut I will guide you accordingly. As soon as the fund reaches, I will\ \ then come over to meet you in person, so that we can discuss physically on Investment\ \ entials.Based on this instance I and my family have unanimously decided to give\ \ you 20% of the total money and annual 5% of the after tax returns on investment\ \ for the first three years. Thereafter, the term shall be varied. 2% for charity\ \ homes and 3% for expenses, which may arise during the transaction, fax and phone\ \ bills inclusive. The balance of 70% you will invest and manage for my family.\ \ I hereby guarantee you that this is not government money, it is not drug money\ \ and it is not money from arms deal.\nThough you have to maintain high degree\ \ of confidentiality on this matter. \n \nI will give you all proof of deposit\ \ and existence of money once urged and fully satisfied with you capability and\ \ honesty. I hope this will be the beginning of a prosperous relationship between\ \ my family and your family. Nevertheless if you are for any reason not interest,\ \ kindly inform me immediately so that I will look for another contact.\n \nI\ \ required also your private phone and fax numbers for easy communication.I am\ \ waiting for your quick response through my private phone or fax Number.\n \n\ I am waiting for your quick response. \n \nYours faithfully, \n \nPrince Tunde\ \ Olusola Adisaraki (For the Family)" pipeline_tag: text-classification inference: true model-index: - name: SetFit with sentence-transformers/all-MiniLM-L6-v2 results: - task: type: text-classification name: Text Classification dataset: name: Unknown type: unknown split: test metrics: - type: accuracy value: 0.96875 name: Accuracy --- # SetFit with sentence-transformers/all-MiniLM-L6-v2 This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification. The model has been trained using an efficient few-shot learning technique that involves: 1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning. 2. Training a classification head with features from the fine-tuned Sentence Transformer. ## Model Details ### Model Description - **Model Type:** SetFit - **Sentence Transformer body:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance - **Maximum Sequence Length:** 256 tokens - **Number of Classes:** 2 classes ### Model Sources - **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit) - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055) - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit) ### Model Labels | Label | Examples | |:------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | 1 | | | 0 | | ## Evaluation ### Metrics | Label | Accuracy | |:--------|:---------| | **all** | 0.9688 | ## Uses ### Direct Use for Inference First install the SetFit library: ```bash pip install setfit ``` Then you can load this model and run inference. ```python from setfit import SetFitModel # Download from the 🤗 Hub model = SetFitModel.from_pretrained("rendulic/setfit-ll-MiniLM-L6-v2-email-fraud-2024-05-18") # Run inference preds = model("How to resolve! www.rewire.comInternational Financial Services - RewireInternational Financial Services - RewireGood Day YvonneOpen the attach file sent ,after the departmental payment receipt has be uploaded we also sent awareness letter note to Mr chalan which should be sent to your bank directly by chalan,Please ensure chalan uploads the departmental payment receipt receipt as soon as possible because the amount to your account is more than $100,000 when converted from pound sterling to USD,please write him (chalan)as soon as possible to settle thisKind RegardsReire Paying Deptwww.rewire.com") ``` ## Training Details ### Training Set Metrics | Training set | Min | Median | Max | |:-------------|:----|:-------|:----| | Word count | 1 | 260.5 | 816 | | Label | Training Sample Count | |:------|:----------------------| | 0 | 18 | | 1 | 14 | ### Training Hyperparameters - batch_size: (32, 32) - num_epochs: (3, 3) - max_steps: -1 - sampling_strategy: oversampling - num_iterations: 60 - body_learning_rate: (0.0001, 0.0001) - head_learning_rate: 0.0001 - loss: CosineSimilarityLoss - distance_metric: cosine_distance - margin: 0.25 - end_to_end: False - use_amp: False - warmup_proportion: 0.1 - seed: 42 - eval_max_steps: -1 - load_best_model_at_end: False ### Training Results | Epoch | Step | Training Loss | Validation Loss | |:------:|:----:|:-------------:|:---------------:| | 0.0083 | 1 | 0.2559 | - | | 0.4167 | 50 | 0.0007 | - | | 0.8333 | 100 | 0.0002 | - | | 1.25 | 150 | 0.0002 | - | | 1.6667 | 200 | 0.0001 | - | | 2.0833 | 250 | 0.0001 | - | | 2.5 | 300 | 0.0001 | - | | 2.9167 | 350 | 0.0001 | - | ### Framework Versions - Python: 3.10.12 - SetFit: 1.0.3 - Sentence Transformers: 2.7.0 - Transformers: 4.40.2 - PyTorch: 2.2.1+cu121 - Datasets: 2.19.1 - Tokenizers: 0.19.1 ## Citation ### BibTeX ```bibtex @article{https://doi.org/10.48550/arxiv.2209.11055, doi = {10.48550/ARXIV.2209.11055}, url = {https://arxiv.org/abs/2209.11055}, author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren}, keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences}, title = {Efficient Few-Shot Learning Without Prompts}, publisher = {arXiv}, year = {2022}, copyright = {Creative Commons Attribution 4.0 International} } ```