Edit model card

SetFit with sentence-transformers/paraphrase-MiniLM-L6-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-MiniLM-L6-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. Fine-tuning a Sentence Transformer with contrastive learning.
  2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Sources

Model Labels

Label Examples
Fabric ID 0462
  • 'What type of fabric is recommended for creating comfortable clothing that is resistant to wear and tear?'
  • 'What type of fabric is best for creating garments with slight nubs and variations for a natural look?'
  • 'Where can I buy durable cotton fabric in deep olive green for everyday wear?'
Fabric ID 0719_1
  • 'What is a tightly woven fabric suitable for lightweight jackets and formal trousers?'
  • 'What fabric is not ideal for garments requiring significant stretch or drape, such as knitwear or flowy dresses?'
  • 'Which textile is best for garments that need a subtle texture and medium weight?'
Fabric ID 0862
  • 'Searching for a dark gray textile with a soft texture and fine weave pattern suitable for making skirts and dresses.'
  • 'What fabric type is recommended for making garments that need to maintain their shape while being comfortable and adaptable for different styles?'
  • 'Which fabric is suitable for making clothes that maintain their shape but also provide comfort and flexibility?'
Fabric ID 0573_1
  • 'What fabric has a raised texture and tight weave for garments that require strength and longevity?'
  • 'What fabric is recommended for garments that require both comfort and resilience?'
  • 'What is the best fabric for creating outerwear with a medium weight and good body?'
Fabric ID 0455
  • 'What kind of textile is suitable for crafting lightweight summer dresses with a fluid drape and hint of elasticity?'
  • 'What type of textile and weave is consistent with an interlocking loop structure and stretchable properties?'
  • 'What fabric can I use to make soft loungewear that has a luxurious feel and good performance in apparel?'
Fabric ID 0735
  • 'What fabric has moisture-wicking properties for sporty summer wear?'
  • 'Where to find textiles suitable for people with sensitive skin for comfortable wear?'
  • 'What are the best fabrics for moisture-wicking properties in sporty or casual summer wear?'
Fabric ID 0863
  • 'What fabric is recommended for making durable clothing with a smooth, consistent grain?'
  • 'Which fabric has a solid color resembling taupe and a moderate saturation?'
  • 'What kind of textile is good for creating garments with a soft drape and gentle folds?'
Fabric ID 0600
  • 'What fabric is best suited for creating clothing with a fine gauge knit and a smooth flow for ease of movement?'
  • 'What fabric is ideal for making form-fitting leggings and sports tops with good stretch and flexibility?'
  • 'What type of fabric is recommended for crafting garments with a consistent dark gray hue and a slight sheen on the surface?'
Fabric ID 0736
  • 'Where can I find a high-quality textile ideal for making athletic wear with stretchability?'
  • 'What textile is perfect for making garments that require both structure and elasticity?'
  • 'Which fabric is ideal for creating athletic wear with strong saturation and even color distribution?'
Fabric ID 0527_1
  • 'What fabric has a textured surface with visible loops and a cozy hand feel?'
  • 'What fabric is best for making durable garments that have a mottled black, white, and gray appearance?'
  • 'What type of fabric displays a mottled grayscale coloration with a melange effect?'
Fabric ID 0453
  • 'Which fabric has a fine knit weave, smooth texture, and a slight sheen?'
  • 'What is the most suitable fabric for creating clothing items for individuals with sensitive skin?'
  • 'What fabric can I use for creating lightweight and breathable summer tops with a soft texture?'
Fabric ID 0859
  • 'What type of fabric is this deep blue twill textile with a slight rough texture and medium-weight suitable for?'
  • 'What fabric would be suitable for making comfortable and form-fitting jeans?'
  • 'What type of fabric is ideal for making durable and form-fitting jeans?'
Fabric ID 0745
  • 'What is the composition of the knit fabric with a fluid drape and some stretch?'
  • 'What fabric would be best for making form-fitting dresses that require some stretch and elasticity?'
  • 'What fabric is suitable for form-fitting clothing like t-shirts, leggings, and dresses?'
Fabric ID 0513
  • 'Which textile is suitable for garments that need a delicate fall and a matte finish?'
  • 'What fabric is recommended for creating linings in apparel due to its lightness and versatility?'
  • 'What is a versatile fabric option for making shirts that are both comfortable and durable?'
Fabric ID 0873
  • 'Which textile exhibits a striped pattern achieved through yarn dyeing for a sharp contrast?'
  • 'What type of cotton fabric has a smooth texture and is suitable for making summer dresses?'
  • 'Which fabric is suitable for making casual shirting with a soft hand feel and fluid drape?'
Fabric ID 0576_1
  • 'What material is floppy with some flexibility but not significant stretch?'
  • 'Which fabric is better for utility wear rather than structured silhouettes?'
  • 'What textile has small colorful fibers and lacks a traditional woven or knitted structure?'
Fabric ID 0456
  • 'What fabric is suitable for casual wear and layering in various climates with a subtle sheen and clean surface?'
  • 'What fabric can I use to make moisture-wicking clothing suitable for people with sensitive skin and a versatile look?'
  • 'What fabric can I use to create garments that have a neat finish and attention to detail in the textile processing?'
Fabric ID 0571
  • 'What fabric is versatile for multi-seasonal use, durable, and maintains its shape over time?'
  • 'What fabric is recommended for making leggings and casual wear with a balanced drape and consistent coloring?'
  • 'Where can I find a fabric suitable for multi-seasonal use with a consistent hue and soft hand texture?'
Fabric ID 0462_1
  • 'What type of cotton fabric is ideal for making casual shirts and trousers?'
  • 'Which fabric has a soft drape and medium weight for making versatile garments?'
  • 'What type of fabric is ideal for making versatile garments with good movement and flow?'
Fabric ID 0447
  • 'Which fabric has a clean appearance with a subtle sheen from bamboo fibers?'
  • 'Which fabric is ideal for making garments that need to maintain their shape but have some stretch?'
  • 'What fabric is recommended for making garments with a clean and even black color without significant variations or patterns?'
Fabric ID 0645
  • 'What fabric is suitable for making versatile dresses with a fluid drape and stretchy feel?'
  • 'What type of knit fabric is recommended for creating garments that require a fluid drape and some degree of elasticity?'
  • 'Where can I find a vibrant red fabric with high saturation for making eye-catching garments?'
Fabric ID 0756
  • 'What type of fabric is light grey with a cool undertone and has a soft, fluid drape?'
  • 'What material is best for making comfortable and durable clothing suitable for regular wear?'
  • 'Which fabric offers a combination of comfort, durability, and stretch for versatile garment applications?'
Fabric ID 0612
  • 'What fabric can I use to make comfortable and flexible activewear?'
  • 'What type of fabric is best for making lightweight sweaters with a smooth texture?'
  • 'What type of textile is best for making layering pieces for cooler climates?'
Fabric ID 0613
  • 'What textile is smooth with fine threads and a gentle drape?'
  • 'What is the best fabric for creating breathable and comfortable dresses for warm weather?'
  • 'What type of fabric is best for creating lightweight blouses with a soft drape?'
Fabric ID 0768
  • "Which textile is lightweight and breathable, suitable for children's wear with a green and blue floral design?"
  • 'Ideal textile for t-shirts that require a degree of stretchability'
  • 'Which fabric is recommended for creating garments with moisture-wicking properties and a vibrant color palette?'
Fabric ID 0748
  • 'What type of fabric is this medium grey textile with a smooth drape and slight stretch?'
  • 'What is the best fabric for making light sweaters that are durable and long-lasting?'
  • 'What type of fabric is ideal for making everyday wear garments with a smooth texture and solid color?'
Fabric ID 0528_1
  • 'What fabric is textured with fine loops and suitable for creating garments that require some structural qualities?'
  • 'What fabric exhibits a brushed or fleeced finish and would be perfect for crafting cozy winter clothing?'
  • 'What fabric is recommended for fall and winter activewear due to its warmth and comfort?'
Fabric ID 0874
  • 'What is a versatile cotton fabric with fine to medium thread count, perfect for creating breathable garments for warm climates?'
  • 'What fabric is ideal for making blouses and dresses with a simple, unadorned aesthetic?'
  • 'What fabric is suitable for creating durable and versatile garments without unique finishes?'
Fabric ID 0742
  • 'Looking for a fabric suitable for making lightweight jackets with a soft drape.'
  • 'What type of fabric is commonly used in t-shirts for a comfortable and breathable feel?'
  • 'What kind of textile weave is ideal for crafting casual t-shirts with some stretchability?'
Fabric ID 0769
  • 'Where can I find a knit fabric with a slightly textured surface and fine, soft feel that is comfortable for casual wear?'
  • 'What fabric is versatile and comfortable for casual wear?'
  • 'What knit fabric is ideal for making dresses that require a bit of stretch and versatility in styling?'
Fabric ID 0770
  • 'What fabric would be suitable for making t-shirts that conform well to body shapes and have vibrant hues?'
  • 'Where can I find a jersey knit fabric with a smooth texture and fine knit structure suitable for t-shirts?'
  • 'What type of fabric is this deep purple floral patterned material made of?'
Fabric ID 0448
  • 'What is the best fabric for making clothing with moisture-wicking properties?'
  • 'What type of fabric would be recommended for creating structured garments that also offer stretch and flexibility?'
  • 'What is the best fabric for making clothing with moisture-wicking properties?'
Fabric ID 0725
  • 'What type of textile is ideal for making spring and summer leggings with a smooth texture and stretchability?'
  • 'Which fabric is lightweight and ideal for creating leggings that maintain their shape and offer flexibility?'
  • 'What fabric composition is suitable for creating lightweight jackets that allow for movement and breathability?'
Fabric ID 0579
  • 'What fabric is suitable for making blouses, dresses, skirts, and lightweight jackets?'
  • 'What fabric with a smooth surface and medium weight is suitable for structured garments?'
  • 'What fabric is durable and likely to maintain its color and shape well?'
Fabric ID 0522
  • 'Which fabric is recommended for casual loungewear that needs to be both comfortable and resilient?'
  • 'What is the best fabric blend for making soft and durable lightweight sweaters?'
  • 'What type of fabric offers a good balance between performance and aesthetics for everyday wear?'
Fabric ID 0578
  • 'What fabric has a plain weave pattern, smooth surface, and fine thread count with a slight sheen?'
  • 'Is there a fabric with moderate strength and a smooth finish ideal for creating garments with soft silhouettes?'
  • 'What fabric is 100% Rayon, lightweight, and ideal for creating garments with soft silhouettes?'
Fabric ID 0526_1
  • 'What knit fabric would be suitable for making cozy apparel with warmth without excessive bulk?'
  • 'Which fabric is best for creating casual wear with an understated aesthetic and versatile appeal?'
  • 'What type of fabric is characterized by a melange of earthy tones with a heathered effect?'
Fabric ID 0733
  • 'Where can I find a vibrant blue fabric with consistent dye saturation for t-shirts and activewear?'
  • 'What fabric is best for creating clothing with a consistent, even dye and some stretchability for comfort and durability?'
  • 'Where can I find a knit fabric with vibrant blue color and a smooth, fine texture?'
Fabric ID 0575_1
  • 'What type of polyester fabric offers a comfortable fit with a moderate drape for daily wear?'
  • 'What fabric has a textured surface and slight elasticity for comfortable fit?'
  • 'What type of textile is recommended for garments that require consistent saturation and evenness in color?'
Fabric ID 0579_1
  • 'Which fabric is ideal for creating garments that can withstand regular wear and maintain their texture over time?'
  • 'What type of fabric has a consistent grey hue with a subtle mottled appearance?'
  • 'What polyester textile has a micro crinkle texture and fine threads?'
Fabric ID 0722
  • 'What knit textile is suitable for creating casual dresses with a fluid drape and soft texture?'
  • "I'm searching for a jersey knit fabric with durable, wrinkle-resistant properties for everyday wear, do you have any options?"
  • 'What type of knit fabric is recommended for everyday apparel due to its comfort and ease of movement?'
Fabric ID 0614
  • 'What fabric is best for creating blouses with a clean and crisp appearance?'
  • 'What type of fabric provides a combination of durability and practicality for everyday wear garments?'
  • "I'm looking for a fabric with a clean and crisp appearance that is durable and easy to care for, any suggestions?"
Fabric ID 0575
  • 'What fabric is appropriate for garments that require a hint of texture in the surface?'
  • 'What type of fabric is suitable for creating structured jackets and trousers with a professional look?'
  • 'What fabric is suitable for making medium-weight garments with a hint of roughness in texture?'
Fabric ID 0723
  • 'Interested in a fabric with stretch and recovery for making garments that require some elasticity and resilience?'
  • 'Which fabric is recommended for creating durable clothing suitable for people with sensitive skin, featuring a smooth texture and vibrant blue color with white dots?'
  • 'What fabric is recommended for making polka dot clothing with a smooth surface and vibrant color?'
Fabric ID 0598
  • 'What type of knit textile is recommended for creating layering pieces in solid, dark colors?'
  • 'What is a versatile fabric for creating garments with a matte finish and uniform color?'
  • 'Which fabric is suitable for activewear, leggings, and fitted tops due to its stretchability?'
Fabric ID 0565
  • "What type of fabric is ideal for making playful children's wear with a vibrant speckled pattern?"
  • 'Which fabric is suitable for crafting garments that can hide wear and minor soiling due to its unique speckled pattern?'
  • 'What fabric offers good recovery and fit due to elastane content?'
Fabric ID 0512
  • 'What is a medium weight textile with a soft drape for creating versatile garments?'
  • 'What fabric is lightweight and breathable, perfect for making soft summer blouses?'
  • 'Which fabric is suitable for making soft and comfortable shirts and blouses with a consistent light blue hue?'
Fabric ID 0876
  • 'What type of fabric is suitable for apparel that requires both form and function?'
  • 'Best fabric for creating statement pieces with a pop of color using a twill weave texture?'
  • 'Which fabric has a slightly textured surface with medium fineness threads, ideal for structured garments?'
Fabric ID 0856
  • 'What fabric would be best for making pants that maintain their shape while offering flexibility?'
  • 'What fabric blend offers both comfort and durability for creating long-lasting clothing?'
  • 'Which fabric is known for its simple yet durable qualities with no unique finishes?'
Fabric ID 0608
  • 'What type of fabric is recommended for creating breathable and comfortable clothing for warm weather?'
  • 'What fabric would be suitable for making lightweight sweaters with a ribbed texture and soft hand?'
  • 'What type of fabric is best for making form-fitting t-shirts with a fluid drape?'
Fabric ID 0573
  • 'What fabric blend offers durability and slight stretchability for structured yet comfortable dresses?'
  • 'What fabric is durable yet versatile for various garment constructions?'
  • 'What type of cloth is versatile for various seasons due to its weight and composition?'
Fabric ID 0880
  • 'Need medium weight cotton fabric for creating casual shirts with a balanced color scheme?'
  • 'Looking for plain weave cotton fabric with a fine thread count and even color distribution?'
  • 'Which textile is versatile for various seasons like spring and summer due to its lightness?'
Fabric ID 0450
  • 'Looking for a fabric for casual apparel applications in mild to warm climates with consistent dyeing?'
  • 'Which fabric blend is recommended for creating apparel with both breathability and a gentle flow?'
  • 'Where can I purchase a bamboo-spandex blend fabric suitable for all-season clothing with moisture-wicking properties?'
Fabric ID 0459
  • 'What type of fabric is ideal for creating form-fitting tops with a fluid drape?'
  • 'What fabric composition combines bamboo and Pret fibers for eco-friendly benefits?'
  • 'What fabric can I use to make elegant and comfortable cardigans with stretch properties?'
Fabric ID 0564
  • 'What fabric is recommended for making lightweight garments with a smooth flow and gentle folds?'
  • 'What type of knit fabric is ideal for creating dresses with moderate stretchability?'
  • 'What textile composition includes elastane and bamboo for stretchability and comfort in casual apparel?'
Fabric ID 0731
  • 'What is the ideal textile for crafting activewear with moderate weight and stretch?'
  • 'Where can I find a jersey knit textile with a soft texture and fine fibers for casual wear?'
  • 'What is the recommended material for making activewear that allows for ease of movement?'
Fabric ID 0578_1
  • 'What is the recommended fabric for creating spring and summer wear with a focus on breathability?'
  • 'Which textile is recommended for creating blouses, skirts, and other apparel due to its natural sheen and uniform texture?'
  • 'What type of fabric has a consistent coloration and high level of saturation for apparel applications?'
Fabric ID 0855
  • 'Which fabric has a plain weave construction and a fine thread count for a smooth texture?'
  • 'What fabric is durable and versatile for everyday wear?'
  • 'What fabric can be used to make form-fitting clothing like dresses, thanks to its stretchability?'
Fabric ID 0772
  • 'What fabric can I use to make casual dresses with a smooth texture and a lightweight feel?'
  • 'What is a fabric with a tight structure and smooth drape ideal for making casual summer outfits?'
  • 'What type of fabric is lightweight, breathable, and suitable for layering in variable climates?'
Fabric ID 0606
  • 'What fabric is a periwinkle blue color with medium saturation and no visible defects?'
  • 'What fabric has a soft and smooth texture with fine threads and a knit pattern?'
  • 'Searching for a fabric that is durable, breathable, and suitable for people with sensitive skin, any options?'
Fabric ID 0596
  • 'Are there any fabrics with a simple weave pattern that offer stretchability for semi-fitted garments?'
  • 'What is the best fabric for creating garments with a good balance of structure and elasticity?'
  • 'What fabric is suitable for creating garments that require good stretchability and resilience?'
Fabric ID 0458
  • 'What type of fabric is commonly used in casual wear, loungewear, and active wear due to its durability and performance?'
  • 'What type of fabric is suitable for creating comfortable loungewear and lightweight sweaters with a fine, smooth texture and good fabric care?'
  • 'What is the best fabric for making active wear that offers breathability and performance?'
Fabric ID 0523_1
  • 'What material provides a fluid drape and enough structure for t-shirts and lounge pants?'
  • 'What fabric should I choose for producing clothing with good colorfastness and ease of care in a polyester composition?'
  • 'What is the best material for creating casual dresses with a medium weight drape and a mix of darker and lighter grey tones?'
Fabric ID 0730
  • 'What is the best fabric for making comfortable and stretchy t-shirts with a casual aesthetic?'
  • 'Where can I buy a knit fabric that is versatile in styling and functional qualities for a range of clothing?'
  • 'What type of fabric is durable and suitable for everyday wear with a casual aesthetic?'
Fabric ID 0449
  • 'Which fabric contains bamboo and Spandex for creating comfortable casual dresses?'
  • 'What fabric has a fluid drape and slight elasticity, suitable for summer dresses?'
  • 'What is the recommended fabric for creating draped garments like dresses or tunics?'
Fabric ID 0724
  • 'Which fabric is ideal for creating lightweight sweaters with a comfortable and breathable feel?'
  • 'What type of fabric is ideal for making casual t-shirts with a vibrant striped pattern?'
  • 'What is the recommended textile for making versatile garments that can be layered in cooler climates?'
Fabric ID 0734
  • 'What knit fabric is versatile for use in various seasons and holds its shape well?'
  • 'What type of fabric is recommended for creating casual tops with a gentle, soft drape?'
  • 'What fabric is suitable for making lightweight and comfortable casual tops for everyday wear?'
Fabric ID 0615
  • 'What fabric would be recommended for making moisture-wicking blouses suitable for warm climates?'
  • 'What fabric would be apt for creating garments that require a fine, even weave structure?'
  • 'What is a suitable fabric for creating drapery in light jackets with a slight sheen?'
Fabric ID 0869
  • 'What type of cotton fabric is ideal for making shirts and blouses with a soft drape?'
  • 'What textile has a slightly textured surface with a fine yet distinct weave?'
  • 'Which cotton fabric is versatile and suitable for both menswear and womenswear?'
Fabric ID 0864
  • 'Which fabric is breathable and soft to the touch, suitable for creating comfortable dresses?'
  • 'Which fabric is recommended for making year-round garments with high color saturation?'
  • 'What fabric can be used for making shirts, pants, and dresses that require a smooth drape and a hint of elasticity?'
Fabric ID 0616
  • 'Which fabric is ideal for creating spring and summer collections with a soft touch and lightweight feel?'
  • 'What textile is known for its easy care and durability in garment construction?'
  • 'What type of fabric is best suited for creating blouses with a flowing drape and smooth texture?'
Fabric ID 0866
  • 'Which fabric is durable, resilient, and has a slight give due to the Spandex content?'
  • 'What fabric has a consistent charcoal gray hue with a matte finish and a twill weave pattern?'
  • 'What fabric is recommended for making form-fitting jackets that are both durable and breathable?'
Fabric ID 0601
  • 'What fabric would be suitable for creating draped skirts with a smooth surface and stretchability?'
  • 'What is the best textile for creating draped skirts with a subtle iridescence?'
  • 'Searching for a fabric with a smooth texture and slight shimmer effect for draped skirts?'
Fabric ID 0618
  • 'What fabric has a soft drape and gentle folds, making it perfect for creating flowy and comfortable spring and summer dresses?'
  • 'What type of knit fabric offers good resistance to wrinkles and shrinkage for practical everyday wear?'
  • 'Searching for a polyester knit fabric with a consistent hue and saturation for making versatile and adaptable garments.'
Fabric ID 0773
  • 'Which fabric is versatile and suitable for creating durable garments for everyday wear?'
  • 'What fabric is suitable for making casual wear like t-shirts, dresses, and tops?'
  • 'What fabric is known for its stable weave with a small percentage of elastane for comfort and durability?'

Evaluation

Metrics

Label Accuracy
all 0.3837

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Jazielinho/fabric_model_1")
# Run inference
preds = model("What fabric has a comfortable feel and is suitable for people with sensitive skin?")

Training Details

Training Set Metrics

Training set Min Median Max
Word count 7 15.4858 30
Label Training Sample Count
Fabric ID 0447 39
Fabric ID 0448 40
Fabric ID 0449 41
Fabric ID 0450 32
Fabric ID 0453 37
Fabric ID 0455 33
Fabric ID 0456 36
Fabric ID 0458 40
Fabric ID 0459 30
Fabric ID 0462 36
Fabric ID 0462_1 42
Fabric ID 0512 38
Fabric ID 0513 39
Fabric ID 0522 43
Fabric ID 0523_1 41
Fabric ID 0526_1 41
Fabric ID 0527_1 35
Fabric ID 0528_1 42
Fabric ID 0564 40
Fabric ID 0565 43
Fabric ID 0571 44
Fabric ID 0573 36
Fabric ID 0573_1 37
Fabric ID 0575 40
Fabric ID 0575_1 44
Fabric ID 0576_1 42
Fabric ID 0578 41
Fabric ID 0578_1 38
Fabric ID 0579 41
Fabric ID 0579_1 46
Fabric ID 0596 41
Fabric ID 0598 38
Fabric ID 0600 40
Fabric ID 0601 39
Fabric ID 0606 41
Fabric ID 0608 44
Fabric ID 0612 45
Fabric ID 0613 40
Fabric ID 0614 37
Fabric ID 0615 44
Fabric ID 0616 39
Fabric ID 0618 42
Fabric ID 0645 36
Fabric ID 0719_1 43
Fabric ID 0722 42
Fabric ID 0723 37
Fabric ID 0724 41
Fabric ID 0725 44
Fabric ID 0730 36
Fabric ID 0731 40
Fabric ID 0733 43
Fabric ID 0734 44
Fabric ID 0735 39
Fabric ID 0736 38
Fabric ID 0742 38
Fabric ID 0745 43
Fabric ID 0748 41
Fabric ID 0756 44
Fabric ID 0768 40
Fabric ID 0769 41
Fabric ID 0770 35
Fabric ID 0772 43
Fabric ID 0773 41
Fabric ID 0855 43
Fabric ID 0856 37
Fabric ID 0859 41
Fabric ID 0862 36
Fabric ID 0863 38
Fabric ID 0864 42
Fabric ID 0866 41
Fabric ID 0869 39
Fabric ID 0873 43
Fabric ID 0874 34
Fabric ID 0876 40
Fabric ID 0880 41

Training Hyperparameters

  • batch_size: (256, 256)
  • num_epochs: (20, 20)
  • max_steps: -1
  • sampling_strategy: undersampling
  • body_learning_rate: (2e-05, 1e-05)
  • head_learning_rate: 0.01
  • loss: CosineSimilarityLoss
  • distance_metric: cosine_distance
  • margin: 0.25
  • end_to_end: False
  • use_amp: False
  • warmup_proportion: 0.1
  • seed: 42
  • eval_max_steps: -1
  • load_best_model_at_end: True

Training Results

Epoch Step Training Loss Validation Loss
0.0021 1 0.2732 -
0.1040 50 0.2348 -
0.2079 100 0.2277 -
0.3119 150 0.2419 -
0.4158 200 0.2401 -
0.5198 250 0.2367 -
0.6237 300 0.237 -
0.7277 350 0.2372 -
0.8316 400 0.2283 -
0.9356 450 0.223 -
1.0 481 - 0.207
1.0395 500 0.2075 -
1.1435 550 0.2162 -
1.2474 600 0.1984 -
1.3514 650 0.2173 -
1.4553 700 0.2154 -
1.5593 750 0.1912 -
1.6632 800 0.2014 -
1.7672 850 0.1866 -
1.8711 900 0.1933 -
1.9751 950 0.1821 -
2.0 962 - 0.1863
2.0790 1000 0.1607 -
2.1830 1050 0.1544 -
2.2869 1100 0.1624 -
2.3909 1150 0.1586 -
2.4948 1200 0.1445 -
2.5988 1250 0.1662 -
2.7027 1300 0.1515 -
2.8067 1350 0.158 -
2.9106 1400 0.1316 -
3.0 1443 - 0.1824
3.0146 1450 0.138 -
3.1185 1500 0.1414 -
3.2225 1550 0.1249 -
3.3264 1600 0.1336 -
3.4304 1650 0.1249 -
3.5343 1700 0.1308 -
3.6383 1750 0.1088 -
3.7422 1800 0.122 -
3.8462 1850 0.1029 -
3.9501 1900 0.1065 -
4.0 1924 - 0.1836
4.0541 1950 0.1133 -
4.1580 2000 0.1102 -
4.2620 2050 0.1209 -
4.3659 2100 0.1054 -
4.4699 2150 0.0874 -
4.5738 2200 0.0896 -
4.6778 2250 0.1104 -
4.7817 2300 0.0912 -
4.8857 2350 0.0766 -
4.9896 2400 0.0778 -
5.0 2405 - 0.1952
5.0936 2450 0.114 -
5.1975 2500 0.0869 -
5.3015 2550 0.0912 -
5.4054 2600 0.103 -
5.5094 2650 0.0748 -
5.6133 2700 0.0911 -
5.7173 2750 0.0721 -
5.8212 2800 0.0964 -
5.9252 2850 0.0712 -
6.0 2886 - 0.1938
6.0291 2900 0.0831 -
6.1331 2950 0.0924 -
6.2370 3000 0.0862 -
6.3410 3050 0.0725 -
6.4449 3100 0.0828 -
6.5489 3150 0.0645 -
6.6528 3200 0.0741 -
6.7568 3250 0.0589 -
6.8607 3300 0.075 -
6.9647 3350 0.075 -
7.0 3367 - 0.2016
7.0686 3400 0.0893 -
7.1726 3450 0.0727 -
7.2765 3500 0.0669 -
7.3805 3550 0.0702 -
7.4844 3600 0.0636 -
7.5884 3650 0.0605 -
7.6923 3700 0.0707 -
7.7963 3750 0.0597 -
7.9002 3800 0.0577 -
8.0 3848 - 0.2067
8.0042 3850 0.0515 -
8.1081 3900 0.0686 -
8.2121 3950 0.0587 -
8.3160 4000 0.057 -
8.4200 4050 0.0693 -
8.5239 4100 0.0812 -
8.6279 4150 0.0592 -
8.7318 4200 0.07 -
8.8358 4250 0.064 -
8.9397 4300 0.0503 -
9.0 4329 - 0.2122
9.0437 4350 0.0489 -
9.1476 4400 0.0602 -
9.2516 4450 0.0673 -
9.3555 4500 0.0665 -
9.4595 4550 0.0672 -
9.5634 4600 0.07 -
9.6674 4650 0.042 -
9.7713 4700 0.0656 -
9.8753 4750 0.0557 -
9.9792 4800 0.0648 -
10.0 4810 - 0.215
10.0832 4850 0.0455 -
10.1871 4900 0.0668 -
10.2911 4950 0.0453 -
10.3950 5000 0.0555 -
10.4990 5050 0.0679 -
10.6029 5100 0.0516 -
10.7069 5150 0.0448 -
10.8108 5200 0.0458 -
10.9148 5250 0.0544 -
11.0 5291 - 0.2172
11.0187 5300 0.0453 -
11.1227 5350 0.0442 -
11.2266 5400 0.0396 -
11.3306 5450 0.0507 -
11.4345 5500 0.0515 -
11.5385 5550 0.0503 -
11.6424 5600 0.0521 -
11.7464 5650 0.0551 -
11.8503 5700 0.0572 -
11.9543 5750 0.0604 -
12.0 5772 - 0.2245
12.0582 5800 0.0445 -
12.1622 5850 0.0564 -
12.2661 5900 0.0449 -
12.3701 5950 0.0502 -
12.4740 6000 0.0517 -
12.5780 6050 0.0426 -
12.6819 6100 0.0386 -
12.7859 6150 0.0446 -
12.8898 6200 0.0574 -
12.9938 6250 0.0546 -
13.0 6253 - 0.223
13.0977 6300 0.0381 -
13.2017 6350 0.047 -
13.3056 6400 0.0425 -
13.4096 6450 0.0445 -
13.5135 6500 0.056 -
13.6175 6550 0.0533 -
13.7214 6600 0.0466 -
13.8254 6650 0.0506 -
13.9293 6700 0.0402 -
14.0 6734 - 0.2238
14.0333 6750 0.0375 -
14.1372 6800 0.0447 -
14.2412 6850 0.0584 -
14.3451 6900 0.0348 -
14.4491 6950 0.0459 -
14.5530 7000 0.0465 -
14.6570 7050 0.0421 -
14.7609 7100 0.0537 -
14.8649 7150 0.041 -
14.9688 7200 0.0281 -
15.0 7215 - 0.2247
15.0728 7250 0.0431 -
15.1767 7300 0.039 -
15.2807 7350 0.0408 -
15.3846 7400 0.048 -
15.4886 7450 0.0354 -
15.5925 7500 0.0626 -
15.6965 7550 0.0396 -
15.8004 7600 0.045 -
15.9044 7650 0.0432 -
16.0 7696 - 0.2246
16.0083 7700 0.0385 -
16.1123 7750 0.0368 -
16.2162 7800 0.0628 -
16.3202 7850 0.035 -
16.4241 7900 0.0264 -
16.5281 7950 0.0275 -
16.6320 8000 0.0383 -
16.7360 8050 0.0469 -
16.8399 8100 0.0445 -
16.9439 8150 0.0357 -
17.0 8177 - 0.2268
17.0478 8200 0.0456 -
17.1518 8250 0.053 -
17.2557 8300 0.0498 -
17.3597 8350 0.0368 -
17.4636 8400 0.0473 -
17.5676 8450 0.0422 -
17.6715 8500 0.0362 -
17.7755 8550 0.0292 -
17.8794 8600 0.0431 -
17.9834 8650 0.0412 -
18.0 8658 - 0.2276
18.0873 8700 0.0655 -
18.1913 8750 0.0405 -
18.2952 8800 0.0455 -
18.3992 8850 0.0324 -
18.5031 8900 0.038 -
18.6071 8950 0.0315 -
18.7110 9000 0.0468 -
18.8150 9050 0.0451 -
18.9189 9100 0.032 -
19.0 9139 - 0.2268
19.0229 9150 0.0371 -
19.1268 9200 0.0439 -
19.2308 9250 0.0472 -
19.3347 9300 0.0362 -
19.4387 9350 0.0341 -
19.5426 9400 0.036 -
19.6466 9450 0.0382 -
19.7505 9500 0.0288 -
19.8545 9550 0.04 -
19.9584 9600 0.0277 -
20.0 9620 - 0.2277
  • The bold row denotes the saved checkpoint.

Framework Versions

  • Python: 3.10.12
  • SetFit: 1.0.3
  • Sentence Transformers: 2.7.0
  • Transformers: 4.40.1
  • PyTorch: 2.2.1+cu121
  • Datasets: 2.19.0
  • Tokenizers: 0.19.1

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
Downloads last month
31
Safetensors
Model size
22.7M params
Tensor type
F32
·

Finetuned from

Evaluation results