Edit model card

SetFit with sentence-transformers/paraphrase-mpnet-base-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A MultiOutputClassifier instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. Fine-tuning a Sentence Transformer with contrastive learning.
  2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Sources

Model Labels

Label Examples
1
  • '1. Short title \nThis Act may be cited as the Innovators Job Creation Act. 2. Permanent extension \n(a) In general \nSection 41 of the Internal Revenue Code of 1986 is amended by striking subsection (h) and inserting the following: (h) Termination of alternative incremental credit \nNo election under subsection (c)(4) shall apply to taxable years beginning after December 31, 2008.. (b) Effective date \nThe amendment made by this section shall apply to amounts paid or incurred after December 31, 2013. 3. Credit allowed against alternative minimum tax \nSubparagraph (B) of section 38(c)(4) of the Internal Revenue Code of 1986 is amended— (1) by redesignating clauses (ii), (iii), (iv), (v), (vi), (vii), (viii), and (ix) as clauses (iii), (iv), (v), (vi), (vii), (viii), (ix), and (x), respectively, and (2) by inserting after clause (i) the following new clause: (ii) the credit determined under section 41 to the extent attributable to amounts paid or incurred after December 31, 2013,. 4. Permanent 5-year carryback for research credits of small businesses \n(a) In general \nParagraph (4) of section 39(a) of the Internal Revenue Code of 1986 is amended to read as follows: (4) 5-year carryback for research credits of small businesses \nNotwithstanding subsection (d), in the case of credits determined under section 41 with respect to an eligible small business (as defined in section 38(c)(5)(C)) in taxable years beginning after December 31, 2013— (A) paragraph (1) shall be applied by substituting each of the 5 taxable years for the taxable year in subparagraph (A) thereof, and (B) paragraph (2) shall be applied— (i) by substituting 25 taxable years for 21 taxable years in subparagraph (A) thereof, and (ii) by substituting 24 taxable years for 20 taxable years in subparagraph (B) thereof.. (b) Effective date \nThe amendment made by this section shall apply to taxable years beginning after December 31, 2013. 5. Election permitted on amended return \n(a) In general \nParagraph (5) of section 41(c) of the Internal Revenue Code of 1986 is amended by adding at the end the following new subparagraph: (D) Special rule regarding timing of election \nAn election under this paragraph may be made by means of an amendment to the return of tax for the taxable year for which made.. (b) Effective date \nThe amendment made by this section shall apply to taxable years beginning after December 31, 2013. 6. Treatment of research\t\t\t credit for certain startup companies \n(a) In\t\t\t general \n(1) In\t\t\t general \nSection 41 of the Internal Revenue Code of 1986 is\t\t\t amended by adding at the end the following new subsection: (i) Treatment of\t\t\t\tcredit to qualified small businesses \n(1) In\t\t\t\tgeneral \nAt the election of a qualified small business, the\t\t\t\tpayroll tax credit portion of the credit determined under subsection (a) shall\t\t\t\tbe treated as a credit allowed under section 3111(f) (and not under this\t\t\t\tsection). (2) Payroll tax\t\t\t\tcredit portion \nFor purposes of this subsection, the payroll tax\t\t\t\tcredit portion of the credit determined under subsection (a) for any taxable\t\t\t\tyear is so much of such credit as does not exceed $250,000. (3) Qualified small\t\t\t\tbusiness \nFor purposes of this subsection— (A) In\t\t\t\tgeneral \nThe term qualified small business means,\t\t\t\twith respect to any taxable year— (i) a corporation,\t\t\t\tpartnership, or S corporation if— (I) the gross\t\t\t\treceipts (as determined under subsection (c)(7)) of such entity for the taxable\t\t\t\tyear is less than $5,000,000, and (II) such entity did\t\t\t\tnot have gross receipts (as so determined) for any period preceding the\t\t\t\t5-taxable-year period ending with such taxable year, and (ii) any person not\t\t\t\tdescribed in subparagraph (A) if clauses (i) and (ii) of subparagraph (A)\t\t\t\tapplied to such person, determined— (I) by substituting person for entity each place it appears),\t\t\t\tand (II) in the case of\t\t\t\tan individual, by only taking into account the aggregate gross receipts\t\t\t\treceived by such individual in carrying on trades or businesses of such\t\t\t\tindividual. (B) Limitation \nSuch\t\t\t\tterm shall not include an organization which is exempt from taxation under\t\t\t\tsection 501. (4) Election \n(A) In\t\t\t\tgeneral \nIn the case of a partnership or S corporation, an\t\t\t\telection under this subsection shall be made at the entity level. (B) Revocation \nAn\t\t\t\telection under this subsection may not be revoked without the consent of the\t\t\t\tSecretary. (C) Limitation \nA\t\t\t\ttaxpayer may not make an election under this subsection if such taxpayer has\t\t\t\tmade an election under this subsection for 5 or more preceding taxable\t\t\t\tyears. (5) Aggregation\t\t\t\trules \nFor purposes of determining the $250,000 limitation under\t\t\t\tparagraph (2) and determining gross receipts under paragraph (3), all members\t\t\t\tof the same controlled group of corporations (within the meaning of section\t\t\t\t267(f)) and all persons under common control (within the meaning of section\t\t\t\t52(b) but determined by treating an interest of more than 50 percent as a\t\t\t\tcontrolling interest) shall be treated as 1 person. (6) Regulations \nThe\t\t\t\tSecretary shall prescribe such regulations as may be necessary to carry out the\t\t\t\tpurposes of this subsection, including— (A) regulations to\t\t\t\tprevent the avoidance of the purposes of paragraph (3) through the use of\t\t\t\tsuccessor companies or other means, (B) regulations to\t\t\t\tminimize compliance and record-keeping burdens under this subsection for\t\t\t\tstart-up companies, and (C) regulations for\t\t\t\trecapturing the benefit of credits determined under section 3111(f) in cases\t\t\t\twhere there is a subsequent adjustment to the payroll tax credit portion of the\t\t\t\tcredit determined under subsection (a), including requiring amended returns in\t\t\t\tthe cases where there is such an\t\t\t\tadjustment.. (2) Conforming\t\t\t amendment \nSection 280C(c) of the Internal Revenue Code of 1986 is\t\t\t amended by adding at the end the following new paragraph: (5) Treatment of\t\t\t\tqualified small business credit \nFor purposes of determining the\t\t\t\tamount of any credit under section 41(a) under this subsection, any election\t\t\t\tunder section 41(i) shall be\t\t\t\tdisregarded.. (b) Credit allowed\t\t\t against FICA taxes \n(1) In\t\t\t general \nSection 3111 of the Internal Revenue Code of 1986 is\t\t\t amended by adding at the end the following new subsection: (f) Credit for\t\t\t\tresearch expenditures of qualified small businesses \n(1) In\t\t\t\tgeneral \nIn the case of a qualified small business which has made\t\t\t\tan election under section 41(i), there shall be allowed as a credit against the\t\t\t\ttax imposed by subsection (a) on wages paid with respect to the employment of\t\t\t\tall employees of the qualified small business for days in an applicable\t\t\t\tcalendar quarter an amount equal to the payroll tax credit portion of the\t\t\t\tresearch credit determined under section 41(a). (2) Carryover of\t\t\t\tunused credit \nIn any case in which the payroll tax credit portion\t\t\t\tof the research credit determined under section 41(a) exceeds the tax imposed\t\t\t\tunder subsection (a) for an applicable calendar quarter— (A) the succeeding\t\t\t\tcalendar quarter shall be treated as an applicable calendar quarter, and (B) the amount of\t\t\t\tcredit allowed under paragraph (1) shall be reduced by the amount of credit\t\t\t\tallowed under such paragraph for all preceding applicable calendar\t\t\t\tquarters. (3) Allocation of\t\t\t\tcredit for controlled groups, etc \nIn determining the amount of\t\t\t\tthe credit under this subsection— (A) all persons\t\t\t\ttreated as a single taxpayer under section 41 shall be treated as a single\t\t\t\ttaxpayer under this section, and (B) the credit (if\t\t\t\tany) allowable by this section to each such member shall be its proportionate\t\t\t\tshare of the qualified research expenses, basic research payments, and amounts\t\t\t\tpaid or incurred to energy research consortiums, giving rise to the credit\t\t\t\tallowable under section 41. (4) Definitions \nFor\t\t\t\tpurposes of this subsection— (A) Applicable\t\t\t\tcalendar quarter \nThe term applicable calendar\t\t\t\tquarter means— (i) the first\t\t\t\tcalendar quarter following the date on which the qualified small business files\t\t\t\ta return under section 6012 for the taxable year for which the payroll tax\t\t\t\tcredit portion of the research credit under section 41(a) is determined,\t\t\t\tand (ii) any succeeding\t\t\t\tcalendar quarter treated as an applicable calendar quarter under paragraph\t\t\t\t(2)(A). For\t\t\t\tpurposes of determining the date on which a return is filed, rules similar to\t\t\t\tthe rules of section 6513 shall apply. (B) Other\t\t\t\tterms \nAny term used in this subsection which is also used in\t\t\t\tsection 41 shall have the meaning given such term under section\t\t\t\t41.. (2) Transfers to\t\t\t federal old-age and survivors insurance trust fund \nThere are\t\t\t hereby appropriated to the Federal Old-Age and Survivors Trust Fund and the\t\t\t Federal Disability Insurance Trust Fund established under section 201 of the\t\t\t Social Security Act ( 42 U.S.C. 401 ) amounts equal to the reduction in revenues\t\t\t to the Treasury by reason of the amendments made by paragraph (1). Amounts\t\t\t appropriated by the preceding sentence shall be transferred from the general\t\t\t fund at such times and in such manner as to replicate to the extent possible\t\t\t the transfers which would have occurred to such Trust Fund had such amendments\t\t\t not been enacted. (c) Effective\t\t\t date \nThe amendments made by this section shall apply to taxable\t\t\t years beginning after December 31, 2013.'

Evaluation

Metrics

Label F1 Accuracy
all 0.6167 0.5007

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("johnwayne117/paraphrase-mpnet-base-v2-bill_committees_us_10k_under_100k")
# Run inference
preds = model("That Congress recognizes the George C. Marshall Museum and George C. Marshall Research Library in Lexington, Virginia, as the National George C. Marshall Museum and Library.")

Training Details

Training Set Metrics

Training set Min Median Max
Word count 2 1219.3091 16000

Training Hyperparameters

  • batch_size: (12, 12)
  • num_epochs: (3, 3)
  • max_steps: -1
  • sampling_strategy: oversampling
  • num_iterations: 5
  • body_learning_rate: (2e-05, 2e-05)
  • head_learning_rate: 2e-05
  • loss: CosineSimilarityLoss
  • distance_metric: cosine_distance
  • margin: 0.25
  • end_to_end: False
  • use_amp: False
  • warmup_proportion: 0.1
  • seed: 42
  • eval_max_steps: -1
  • load_best_model_at_end: False

Training Results

Epoch Step Training Loss Validation Loss
0.0001 1 0.2901 -
0.0059 50 0.2918 -
0.0119 100 0.2449 -
0.0178 150 0.27 -
0.0238 200 0.2412 -
0.0297 250 0.2597 -
0.0357 300 0.1717 -
0.0416 350 0.2339 -
0.0476 400 0.2027 -
0.0535 450 0.1545 -
0.0595 500 0.1656 -
0.0654 550 0.1031 -
0.0714 600 0.129 -
0.0773 650 0.222 -
0.0833 700 0.1617 -
0.0892 750 0.2098 -
0.0952 800 0.0979 -
0.1011 850 0.1382 -
0.1071 900 0.1367 -
0.1130 950 0.1985 -
0.1189 1000 0.2455 -
0.1249 1050 0.1414 -
0.1308 1100 0.1666 -
0.1368 1150 0.052 -
0.1427 1200 0.1629 -
0.1487 1250 0.1237 -
0.1546 1300 0.1725 -
0.1606 1350 0.0952 -
0.1665 1400 0.2234 -
0.1725 1450 0.1184 -
0.1784 1500 0.0545 -
0.1844 1550 0.1577 -
0.1903 1600 0.1255 -
0.1963 1650 0.2058 -
0.2022 1700 0.2033 -
0.2082 1750 0.2517 -
0.2141 1800 0.138 -
0.2201 1850 0.146 -
0.2260 1900 0.0356 -
0.2319 1950 0.2003 -
0.2379 2000 0.0757 -
0.2438 2050 0.2136 -
0.2498 2100 0.0944 -
0.2557 2150 0.1373 -
0.2617 2200 0.1306 -
0.2676 2250 0.1015 -
0.2736 2300 0.1874 -
0.2795 2350 0.0907 -
0.2855 2400 0.1351 -
0.2914 2450 0.1274 -
0.2974 2500 0.1722 -
0.3033 2550 0.1433 -
0.3093 2600 0.2584 -
0.3152 2650 0.1258 -
0.3212 2700 0.235 -
0.3271 2750 0.159 -
0.3331 2800 0.0893 -
0.3390 2850 0.1251 -
0.3450 2900 0.0845 -
0.3509 2950 0.1765 -
0.3568 3000 0.1176 -
0.3628 3050 0.1989 -
0.3687 3100 0.1048 -
0.3747 3150 0.0495 -
0.3806 3200 0.1243 -
0.3866 3250 0.0773 -
0.3925 3300 0.1269 -
0.3985 3350 0.1084 -
0.4044 3400 0.1119 -
0.4104 3450 0.1813 -
0.4163 3500 0.1284 -
0.4223 3550 0.1007 -
0.4282 3600 0.0304 -
0.4342 3650 0.2466 -
0.4401 3700 0.2102 -
0.4461 3750 0.0462 -
0.4520 3800 0.1032 -
0.4580 3850 0.0883 -
0.4639 3900 0.0758 -
0.4698 3950 0.0862 -
0.4758 4000 0.2094 -
0.4817 4050 0.1348 -
0.4877 4100 0.0654 -
0.4936 4150 0.1754 -
0.4996 4200 0.1934 -
0.5055 4250 0.0114 -
0.5115 4300 0.0141 -
0.5174 4350 0.0467 -
0.5234 4400 0.0691 -
0.5293 4450 0.1598 -
0.5353 4500 0.034 -
0.5412 4550 0.075 -
0.5472 4600 0.2906 -
0.5531 4650 0.136 -
0.5591 4700 0.0473 -
0.5650 4750 0.0442 -
0.5710 4800 0.0392 -
0.5769 4850 0.0478 -
0.5828 4900 0.0941 -
0.5888 4950 0.0129 -
0.5947 5000 0.134 -
0.6007 5050 0.2215 -
0.6066 5100 0.1762 -
0.6126 5150 0.0159 -
0.6185 5200 0.1521 -
0.6245 5250 0.1168 -
0.6304 5300 0.075 -
0.6364 5350 0.092 -
0.6423 5400 0.2167 -
0.6483 5450 0.1027 -
0.6542 5500 0.1017 -
0.6602 5550 0.1344 -
0.6661 5600 0.0952 -
0.6721 5650 0.0127 -
0.6780 5700 0.0497 -
0.6840 5750 0.055 -
0.6899 5800 0.0923 -
0.6958 5850 0.0924 -
0.7018 5900 0.1494 -
0.7077 5950 0.0442 -
0.7137 6000 0.0342 -
0.7196 6050 0.0646 -
0.7256 6100 0.1835 -
0.7315 6150 0.0288 -
0.7375 6200 0.0454 -
0.7434 6250 0.0511 -
0.7494 6300 0.0653 -
0.7553 6350 0.0747 -
0.7613 6400 0.0595 -
0.7672 6450 0.1918 -
0.7732 6500 0.0514 -
0.7791 6550 0.0669 -
0.7851 6600 0.1178 -
0.7910 6650 0.1462 -
0.7970 6700 0.1617 -
0.8029 6750 0.1219 -
0.8088 6800 0.1518 -
0.8148 6850 0.2049 -
0.8207 6900 0.141 -
0.8267 6950 0.085 -
0.8326 7000 0.0979 -
0.8386 7050 0.027 -
0.8445 7100 0.1752 -
0.8505 7150 0.1348 -
0.8564 7200 0.1945 -
0.8624 7250 0.0498 -
0.8683 7300 0.0373 -
0.8743 7350 0.1372 -
0.8802 7400 0.0247 -
0.8862 7450 0.0122 -
0.8921 7500 0.2109 -
0.8981 7550 0.174 -
0.9040 7600 0.0574 -
0.9100 7650 0.118 -
0.9159 7700 0.0822 -
0.9219 7750 0.1084 -
0.9278 7800 0.1966 -
0.9337 7850 0.0967 -
0.9397 7900 0.0704 -
0.9456 7950 0.0429 -
0.9516 8000 0.2362 -
0.9575 8050 0.1233 -
0.9635 8100 0.0885 -
0.9694 8150 0.0494 -
0.9754 8200 0.1398 -
0.9813 8250 0.2208 -
0.9873 8300 0.1785 -
0.9932 8350 0.0113 -
0.9992 8400 0.053 -
1.0051 8450 0.2495 -
1.0111 8500 0.124 -
1.0170 8550 0.0962 -
1.0230 8600 0.0378 -
1.0289 8650 0.126 -
1.0349 8700 0.1048 -
1.0408 8750 0.1043 -
1.0467 8800 0.0587 -
1.0527 8850 0.128 -
1.0586 8900 0.0181 -
1.0646 8950 0.1592 -
1.0705 9000 0.0473 -
1.0765 9050 0.1365 -
1.0824 9100 0.0409 -
1.0884 9150 0.1683 -
1.0943 9200 0.1103 -
1.1003 9250 0.0481 -
1.1062 9300 0.1 -
1.1122 9350 0.1517 -
1.1181 9400 0.0671 -
1.1241 9450 0.1553 -
1.1300 9500 0.1459 -
1.1360 9550 0.0664 -
1.1419 9600 0.1619 -
1.1479 9650 0.0572 -
1.1538 9700 0.0432 -
1.1597 9750 0.0882 -
1.1657 9800 0.0909 -
1.1716 9850 0.1555 -
1.1776 9900 0.0678 -
1.1835 9950 0.1117 -
1.1895 10000 0.0352 -
1.1954 10050 0.0901 -
1.2014 10100 0.0249 -
1.2073 10150 0.0998 -
1.2133 10200 0.0489 -
1.2192 10250 0.0468 -
1.2252 10300 0.1429 -
1.2311 10350 0.1688 -
1.2371 10400 0.0783 -
1.2430 10450 0.0673 -
1.2490 10500 0.0193 -
1.2549 10550 0.0504 -
1.2609 10600 0.0303 -
1.2668 10650 0.1921 -
1.2727 10700 0.0964 -
1.2787 10750 0.0143 -
1.2846 10800 0.0728 -
1.2906 10850 0.187 -
1.2965 10900 0.1078 -
1.3025 10950 0.0468 -
1.3084 11000 0.0093 -
1.3144 11050 0.0154 -
1.3203 11100 0.0697 -
1.3263 11150 0.0855 -
1.3322 11200 0.0203 -
1.3382 11250 0.0757 -
1.3441 11300 0.286 -
1.3501 11350 0.0901 -
1.3560 11400 0.085 -
1.3620 11450 0.024 -
1.3679 11500 0.1212 -
1.3739 11550 0.0617 -
1.3798 11600 0.0652 -
1.3857 11650 0.0669 -
1.3917 11700 0.1001 -
1.3976 11750 0.1089 -
1.4036 11800 0.063 -
1.4095 11850 0.0694 -
1.4155 11900 0.0259 -
1.4214 11950 0.0789 -
1.4274 12000 0.0388 -
1.4333 12050 0.0551 -
1.4393 12100 0.1506 -
1.4452 12150 0.1739 -
1.4512 12200 0.0487 -
1.4571 12250 0.1109 -
1.4631 12300 0.11 -
1.4690 12350 0.0221 -
1.4750 12400 0.0169 -
1.4809 12450 0.1425 -
1.4869 12500 0.045 -
1.4928 12550 0.0644 -
1.4988 12600 0.0507 -
1.5047 12650 0.0885 -
1.5106 12700 0.01 -
1.5166 12750 0.024 -
1.5225 12800 0.0876 -
1.5285 12850 0.0533 -
1.5344 12900 0.0224 -
1.5404 12950 0.1065 -
1.5463 13000 0.1024 -
1.5523 13050 0.0433 -
1.5582 13100 0.0182 -
1.5642 13150 0.0837 -
1.5701 13200 0.0975 -
1.5761 13250 0.152 -
1.5820 13300 0.1103 -
1.5880 13350 0.0503 -
1.5939 13400 0.0165 -
1.5999 13450 0.037 -
1.6058 13500 0.0551 -
1.6118 13550 0.0501 -
1.6177 13600 0.0591 -
1.6236 13650 0.1212 -
1.6296 13700 0.0722 -
1.6355 13750 0.0476 -
1.6415 13800 0.0707 -
1.6474 13850 0.0407 -
1.6534 13900 0.067 -
1.6593 13950 0.0436 -
1.6653 14000 0.0496 -
1.6712 14050 0.0148 -
1.6772 14100 0.0988 -
1.6831 14150 0.0781 -
1.6891 14200 0.1966 -
1.6950 14250 0.0479 -
1.7010 14300 0.0363 -
1.7069 14350 0.0322 -
1.7129 14400 0.1043 -
1.7188 14450 0.0297 -
1.7248 14500 0.0491 -
1.7307 14550 0.0466 -
1.7366 14600 0.0798 -
1.7426 14650 0.1467 -
1.7485 14700 0.0395 -
1.7545 14750 0.1025 -
1.7604 14800 0.0784 -
1.7664 14850 0.0152 -
1.7723 14900 0.1253 -
1.7783 14950 0.1242 -
1.7842 15000 0.0303 -
1.7902 15050 0.1224 -
1.7961 15100 0.0776 -
1.8021 15150 0.0326 -
1.8080 15200 0.1185 -
1.8140 15250 0.0631 -
1.8199 15300 0.1031 -
1.8259 15350 0.0825 -
1.8318 15400 0.0779 -
1.8378 15450 0.1128 -
1.8437 15500 0.0608 -
1.8496 15550 0.1292 -
1.8556 15600 0.0959 -
1.8615 15650 0.1468 -
1.8675 15700 0.0498 -
1.8734 15750 0.1376 -
1.8794 15800 0.0365 -
1.8853 15850 0.1143 -
1.8913 15900 0.0943 -
1.8972 15950 0.05 -
1.9032 16000 0.1054 -
1.9091 16050 0.0458 -
1.9151 16100 0.1845 -
1.9210 16150 0.0971 -
1.9270 16200 0.0145 -
1.9329 16250 0.1021 -
1.9389 16300 0.0661 -
1.9448 16350 0.0264 -
1.9508 16400 0.1195 -
1.9567 16450 0.0312 -
1.9627 16500 0.0397 -
1.9686 16550 0.0236 -
1.9745 16600 0.0923 -
1.9805 16650 0.0497 -
1.9864 16700 0.0362 -
1.9924 16750 0.0429 -
1.9983 16800 0.0714 -
2.0043 16850 0.0558 -
2.0102 16900 0.1081 -
2.0162 16950 0.0125 -
2.0221 17000 0.1168 -
2.0281 17050 0.0801 -
2.0340 17100 0.1087 -
2.0400 17150 0.1586 -
2.0459 17200 0.0391 -
2.0519 17250 0.1344 -
2.0578 17300 0.1026 -
2.0638 17350 0.0963 -
2.0697 17400 0.0541 -
2.0757 17450 0.0641 -
2.0816 17500 0.0195 -
2.0875 17550 0.0985 -
2.0935 17600 0.1175 -
2.0994 17650 0.1035 -
2.1054 17700 0.0698 -
2.1113 17750 0.0836 -
2.1173 17800 0.0784 -
2.1232 17850 0.1312 -
2.1292 17900 0.0316 -
2.1351 17950 0.033 -
2.1411 18000 0.0812 -
2.1470 18050 0.0335 -
2.1530 18100 0.0369 -
2.1589 18150 0.1199 -
2.1649 18200 0.081 -
2.1708 18250 0.1185 -
2.1768 18300 0.034 -
2.1827 18350 0.0593 -
2.1887 18400 0.0915 -
2.1946 18450 0.1415 -
2.2005 18500 0.0353 -
2.2065 18550 0.1528 -
2.2124 18600 0.0695 -
2.2184 18650 0.0489 -
2.2243 18700 0.0719 -
2.2303 18750 0.1762 -
2.2362 18800 0.0515 -
2.2422 18850 0.2018 -
2.2481 18900 0.0897 -
2.2541 18950 0.082 -
2.2600 19000 0.0751 -
2.2660 19050 0.079 -
2.2719 19100 0.0794 -
2.2779 19150 0.0288 -
2.2838 19200 0.0245 -
2.2898 19250 0.0756 -
2.2957 19300 0.0844 -
2.3017 19350 0.0931 -
2.3076 19400 0.0289 -
2.3135 19450 0.0068 -
2.3195 19500 0.016 -
2.3254 19550 0.0685 -
2.3314 19600 0.0295 -
2.3373 19650 0.0996 -
2.3433 19700 0.0185 -
2.3492 19750 0.0215 -
2.3552 19800 0.0424 -
2.3611 19850 0.0398 -
2.3671 19900 0.0814 -
2.3730 19950 0.0238 -
2.3790 20000 0.1418 -
2.3849 20050 0.0237 -
2.3909 20100 0.1136 -
2.3968 20150 0.1127 -
2.4028 20200 0.081 -
2.4087 20250 0.074 -
2.4147 20300 0.0518 -
2.4206 20350 0.0319 -
2.4265 20400 0.0309 -
2.4325 20450 0.0931 -
2.4384 20500 0.0193 -
2.4444 20550 0.1149 -
2.4503 20600 0.0663 -
2.4563 20650 0.1398 -
2.4622 20700 0.0707 -
2.4682 20750 0.1264 -
2.4741 20800 0.0881 -
2.4801 20850 0.2039 -
2.4860 20900 0.1976 -
2.4920 20950 0.1223 -
2.4979 21000 0.0591 -
2.5039 21050 0.0265 -
2.5098 21100 0.0129 -
2.5158 21150 0.0782 -
2.5217 21200 0.0961 -
2.5277 21250 0.0063 -
2.5336 21300 0.011 -
2.5396 21350 0.0419 -
2.5455 21400 0.0537 -
2.5514 21450 0.0302 -
2.5574 21500 0.0263 -
2.5633 21550 0.0273 -
2.5693 21600 0.0409 -
2.5752 21650 0.083 -
2.5812 21700 0.0274 -
2.5871 21750 0.1862 -
2.5931 21800 0.0527 -
2.5990 21850 0.026 -
2.6050 21900 0.0877 -
2.6109 21950 0.0454 -
2.6169 22000 0.0934 -
2.6228 22050 0.1331 -
2.6288 22100 0.0349 -
2.6347 22150 0.1106 -
2.6407 22200 0.0771 -
2.6466 22250 0.1562 -
2.6526 22300 0.0875 -
2.6585 22350 0.1013 -
2.6644 22400 0.0265 -
2.6704 22450 0.0244 -
2.6763 22500 0.0257 -
2.6823 22550 0.143 -
2.6882 22600 0.0408 -
2.6942 22650 0.0733 -
2.7001 22700 0.0303 -
2.7061 22750 0.0424 -
2.7120 22800 0.0979 -
2.7180 22850 0.0494 -
2.7239 22900 0.0187 -
2.7299 22950 0.0674 -
2.7358 23000 0.0612 -
2.7418 23050 0.0635 -
2.7477 23100 0.0965 -
2.7537 23150 0.0352 -
2.7596 23200 0.0882 -
2.7656 23250 0.0644 -
2.7715 23300 0.1206 -
2.7774 23350 0.0884 -
2.7834 23400 0.1298 -
2.7893 23450 0.0359 -
2.7953 23500 0.0696 -
2.8012 23550 0.0908 -
2.8072 23600 0.0517 -
2.8131 23650 0.0326 -
2.8191 23700 0.0861 -
2.8250 23750 0.0082 -
2.8310 23800 0.0296 -
2.8369 23850 0.1258 -
2.8429 23900 0.0229 -
2.8488 23950 0.0786 -
2.8548 24000 0.0417 -
2.8607 24050 0.1067 -
2.8667 24100 0.0555 -
2.8726 24150 0.1547 -
2.8786 24200 0.1182 -
2.8845 24250 0.0184 -
2.8904 24300 0.1135 -
2.8964 24350 0.0791 -
2.9023 24400 0.0347 -
2.9083 24450 0.0134 -
2.9142 24500 0.0773 -
2.9202 24550 0.0258 -
2.9261 24600 0.0058 -
2.9321 24650 0.0363 -
2.9380 24700 0.1113 -
2.9440 24750 0.0255 -
2.9499 24800 0.0395 -
2.9559 24850 0.089 -
2.9618 24900 0.0518 -
2.9678 24950 0.0975 -
2.9737 25000 0.0358 -
2.9797 25050 0.0747 -
2.9856 25100 0.1717 -
2.9916 25150 0.0466 -
2.9975 25200 0.0241 -

Environmental Impact

Carbon emissions were measured using CodeCarbon.

  • Carbon Emitted: 0.255 kg of CO2
  • Hours Used: 2.944 hours

Framework Versions

  • Python: 3.10.14
  • SetFit: 1.0.3
  • Sentence Transformers: 2.7.0
  • Transformers: 4.40.2
  • PyTorch: 2.3.0
  • Datasets: 2.19.1
  • Tokenizers: 0.19.1

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
Downloads last month
56
Safetensors
Model size
109M params
Tensor type
F32
·

Finetuned from

Evaluation results