Hugging Face's logo

much1na
/
distil-cohere-l2-ckpt

Sentence Similarity
sentence-transformers
Safetensors
bert
feature-extraction
dense
Generated from Trainer
dataset_size:3810976
loss:EmbedDistillLoss
text-embeddings-inference
Model card Files
xet
 Community

SentenceTransformer based on google/bert_uncased_L-6_H-512_A-8

This is a sentence-transformers model finetuned from google/bert_uncased_L-6_H-512_A-8 on the parquet dataset. It maps sentences & paragraphs to a 512-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: google/bert_uncased_L-6_H-512_A-8
  • Maximum Sequence Length: 512 tokens
  • Output Dimensionality: 512 dimensions
  • Similarity Function: Cosine Similarity
  • Supported Modality: Text
  • Training Dataset:
    • parquet

Model Sources

Full Model Architecture 

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 512, 'pooling_mode': 'mean', 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Just 320 FFs were constructed and production ceased in 1971.\nOther projects\nAustin A40 Sports: As one in a series of collaborations between Austin and Jensen, the Austin A40 Sports originated when Austin\'s chairman Leonard Lord, upon seeing the Interceptor, requested that Jensen, and their designer Eric Neale, develop a body that could use the A40 mechanicals.\nThe resulting body-on-frame A40 Sports\xa0– which debuted at the 1949 London Motor Show\xa0– had been designed by Eric Neale, an ex-Wolseley stylist who had joined Jensen in 1946. During production, the A40 Sports\' aluminium bodies were built by Jensen and transported to Austin\'s Longbridge plant for final assembly. The A40 Sports had been intended as more of a sporty touring car and not a sports car per se, and over 4000 examples were manufactured from 1951 to 1953.\nAustin-Healey 100: Although Jensen\'s design for a new Austin-based sports-car was rejected by the British Motor Corporation (BMC) in 1952 in favour of a design provided by Donald Healey, Jensen did win the BMC contract to build the bodies for the resultant Austin-Healey 100 and the rest of the "big Healey" cars. At the end of 1960 Austin-Healey cars occupied about 350 of the 850 men in Jensen\'s factory.',
    'Joshua Steele\'s disagreement, and subsequent correspondence, with Monboddo over details of the "melody and measure of speech" resulted in Steele\'s Prosodia Rationalis, a foundational work both in phonetics and in the analysis of verse rhythm.\nEvolutionary theorist\nMonboddo is considered by some scholars as a precursive thinker in the theory of evolution. However, some modern evolutionary historians do not give Monboddo an equally high standing in the influence of history of evolutionary thought.\n"Monboddo: Scottish jurist and pioneer anthropologist who explored the origins of language and society and anticipated principles of Darwinian evolution."\n"With some wavering, he extended Rousseau\'s doctrine of the identity of species of man and the chimp into the hypothesis of common descent of all the anthropoids, and suggested by implication a general law of evolution." Lovejoy.\nCharles Neaves, one of Monboddo\'s successors on the high court of Scotland, believed that proper credit was not given to Monboddo in evolutionary theory development. Neaves wrote in verse:\nThough Darwin now proclaims the law\nAnd spreads it far abroad, O!\nThe man that first the secret saw\nWas honest old Monboddo.\nThe architect precedence takes\nOf him that bears the hod, O!\nSo up and at them, Land of Cakes,',
    'As a consequence, in May 1833 Ozanam and a group of other young men founded the charitable Society of Saint Vincent de Paul, which already by the time of his death numbered upwards of 2,000 members. The founding members developed their method of service under the guidance of Sister Rosalie Rendu, a member of the Congregation of Daughters of Charity of Saint Vincent de Paul, who was prominent in serving the poor in the slums of Paris. The members of the conferences collaborated with Rendu during the time of the cholera epidemic. When fear had gripped the population, she organized the conferences in all the neighborhoods of Paris to care for the cholera victims, becoming well known in the city for her work, especially in the 12th arrondissement. Frederic\'s first act of charity was to take his supply of winter firewood and bring it to a widow whose husband had died of cholera.\nOzanam received the degrees of Bachelor of Laws in 1834, Bachelor of Arts in 1835 and Doctor of Laws in 1836. His father, who had wanted him to study law, died on 12 May 1837. Although he preferred literature, Ozanam worked in the legal profession in order to support his mother, and was admitted to the Bar in Lyon in 1837.\nIn 1835, Ozanam persuaded Monseigneur de Quélen, the Archbishop of Paris, to ask Jean-Baptiste Henri Lacordaire to preach a Lenten series at the Cathedral of Notre-Dame in Paris, as part of the Notre-Dame Lectures specially aimed at the catechesis of Christian youth, which had been inaugurated at the behest of his friend Ozanam. Lacordaire\'s first lecture took place on 8 March 1835, and was met with wide acclaim. Lacordaire was reputed to be the greatest pulpit orator of the nineteenth century. The social event of its day, it was well-attended and became an annual tradition in Paris. According to Thomas Bokenkotter, Lacordaire\'s Notre Dame Conferences, "...proved to be one of the most dramatic events of nineteenth century church history."',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 512]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.6843, 0.5954],
#         [0.6843, 1.0000, 0.5835],
#         [0.5954, 0.5835, 1.0000]])

Training Details

Training Dataset

parquet

  • Dataset: parquet
  • Size: 3,810,976 training samples
  • Columns: text and label
  • Approximate statistics based on the first 100 samples:
    text label
    type string list
    modality text
    details
    • min: 99 tokens
    • mean: 314.97 tokens
    • max: 505 tokens
    • size: 1024 elements
  • Samples:
    text label
    Negligent homicide is a criminal charge brought against a person who, through criminal negligence, allows another person to die. Other times, an intentional killing may be negotiated down to this lesser charge as a compromised resolution of a murder case, as might occur in the context of the intentional shooting of an unarmed man after a traffic altercation. Negligent homicide can be distinguished from involuntary manslaughter by its mens rea requirement: negligent homicide requires criminal negligence, while manslaughter requires recklessness. [0.07659912109375, -0.01461029052734375, 0.008819580078125, -0.062469482421875, -0.0020580291748046875, ...]
    Latin trap is a subgenre of Latin hip hop music that originated in Puerto Rico. A direct descendant of southern hip hop, and influenced by reggaeton, it gained popularity after 2007, and has since spread throughout Latin America. The trap is slang for a place where drugs are sold. Latin trap is similar to mainstream trap with lyrics about life on la calle (the street), drugs, sex and violence.
    Characteristics
    Latin trap is a subgenre of Latin hip hop, taking influence from Southern hip hop as well as Puerto Rican genres like reggaeton and dembow. Vocals include a bend of rapping and singing using synthesizers and voice distorted autotune, often in Spanish, while still maintaining the trap style sonic circuitry. The lyrics in Latin trap are often about street life, violence, sex, drugs, and people who live on the other side of the law and are proud of it.
    History    		 [-0.0191802978515625, -0.0106353759765625, -0.036407470703125, 0.029571533203125, -0.004840850830078125, ...]
    Surface 3 is a 2-in-1 detachable from the Microsoft Surface series, introduced by Microsoft in 2015. Unlike its predecessor, the Surface 2, Surface 3 utilizes an x86 Intel Atom system-on-chip architecture, or SoC, rather than a processor with ARM architecture such as the Nvidia Tegra that powered the Surface 2, and runs standard versions of Windows 8.1 or Windows 10.
    History
    The older, original Surface (also known as Surface RT) and Surface 2, with their ARM-based processors and Windows RT operating system, were designed to compete with the iPad and other tablets. The first Surface was criticized for performance issues, which were reduced in the succeeding Surface 2. Due to the differing processors, these devices were incompatible with the vast number of Windows programs written for x86-based computers, running only those written and compiled for Windows RT, loaded from Microsoft's application store.    		 [-0.04119873046875, -0.016265869140625, -0.0126800537109375, 0.0103912353515625, -0.0557861328125, ...]
  • Loss: EmbedDistillLoss with these parameters:
    {
    "distance_metric": "l2",
    "projection_dim": 1024
}

Evaluation Dataset

parquet

  • Dataset: parquet
  • Size: 256 evaluation samples
  • Columns: text and label
  • Approximate statistics based on the first 100 samples:
    text label
    type string list
    modality text
    details
    • min: 53 tokens
    • mean: 308.2 tokens
    • max: 512 tokens
    • size: 1024 elements
  • Samples:
    text label
    Revolution Pro Wrestling (2022–present) Slater made his debut in Revolution Pro Wrestling at RevPro Live In London 64 on August 7, 2022, where he unsuccessfully challenged Luke Jacobs for the Undisputed British Cruiserweight Championship. He continued to make regular appearances in the company's signature events such as the British J-Cup, where he made his first appearance at the 202 edition where he defeated Lio Rush in the first rounds but fell short to Robbie X, Lee Hunter and Will Kaven in a four-way match in the finals which occurred on the same night. One year later, Slater succeeded in winning the cup by defeating Will Kaven in the first rounds ans then Harrison Bennett, Mascara Dorada and Wild Boar in the four-way match of the finals. At RevPro Revolution Rumble 2023 on March 26, Slater competed in the traditional royal rumble match, bout won by Michael Oku and also involving various other notable opponents such as Big Damo, Callum Newman, Eddie Dennis, Gabriel Kidd, Francesco ... [-0.026824951171875, 0.03338623046875, 0.011566162109375, 0.01247406005859375, 0.002338409423828125, ...]
    On 9 April 2015, Masagos was promoted to the rank of full Minister but did not have a portfolio yet, so he was a Minister in the Prime Minister's Office. This was the first time in Singaporean history when there were two Malay ministers in the Cabinet, the other being Yaacob Ibrahim. Masagos was also promoted to Second Minister for Home Affairs and Second Minister for Foreign Affairs, and was put in charge of leading the PAP team in Tampines GRC. On the same day, Prime Minister Lee Hsien Loong said that Masagos's elevation to full Minister reflected the "progress of the Malay community" in Singapore. Masagos also said that he was honoured to have been appointed and that "[h]aving two Malay full ministers in the Cabinet for the first time in our nation's history reflects the [Government's] trust and recognition of the good progress made by the Malay-Muslim community".
    On 1 October 2015, Masagos took up the portfolio of Minister for Environment and Water Resources. From 1 May 2018, he wa...    		 [0.039398193359375, -0.022613525390625, 0.006793975830078125, 0.00878143310546875, -0.005939483642578125, ...]
    In the late 15th century the Clan Mackay and Clan Ross had long been at feud. This resulted in the Battle of Tarbat in 1486 where the Mackays were defeated by the Rosses and chief Angus Roy Mackay, 9th of Strathnaver was killed. This was followed by the Battle of Aldy Charrish where the Rosses were defeated by the Mackays and the Ross chief was killed along with many of his clan. According to 17th-century historian Sir Robert Gordon, who was a younger son of Alexander Gordon, 12th Earl of Sutherland, the Clan Sutherland joined the side of the Clan Mackay at this battle. However, 19th-century historian Angus Mackay disputes the Sutherland's presence at the battle stating that it would be unlikely that the Earl of Sutherland at the time would have assisted against the Rosses as he was married to a daughter of the Ross chief of Balnagowan, and also that the feudal superiority of the Sutherlands over the Mackays "nowhere existed save in his own fertile imagination".
    16th century and clan c...    		 [0.06927490234375, 0.021881103515625, 0.01392364501953125, -0.044342041015625, 0.058258056640625, ...]
  • Loss: EmbedDistillLoss with these parameters:
    {
    "distance_metric": "l2",
    "projection_dim": 1024
}

Training Hyperparameters

Non-Default Hyperparameters

  • per_device_train_batch_size: 32
  • max_steps: 36000
  • learning_rate: 2e-05
  • lr_scheduler_type: cosine
  • warmup_steps: 2000
  • fp16: True
  • per_device_eval_batch_size: 32
  • seed: 12

All Hyperparameters

Click to expand
  • per_device_train_batch_size: 32
  • num_train_epochs: 3.0
  • max_steps: 36000
  • learning_rate: 2e-05
  • lr_scheduler_type: cosine
  • lr_scheduler_kwargs: None
  • warmup_steps: 2000
  • optim: adamw_torch_fused
  • optim_args: None
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • optim_target_modules: None
  • gradient_accumulation_steps: 1
  • average_tokens_across_devices: True
  • max_grad_norm: 1.0
  • label_smoothing_factor: 0.0
  • bf16: False
  • fp16: True
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • use_liger_kernel: False
  • liger_kernel_config: None
  • use_cache: False
  • neftune_noise_alpha: None
  • torch_empty_cache_steps: None
  • auto_find_batch_size: False
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • include_num_input_tokens_seen: no
  • log_level: passive
  • log_level_replica: warning
  • disable_tqdm: False
  • project: huggingface
  • trackio_space_id: None
  • trackio_bucket_id: None
  • trackio_static_space_id: None
  • per_device_eval_batch_size: 32
  • prediction_loss_only: True
  • eval_on_start: False
  • eval_do_concat_batches: True
  • eval_use_gather_object: False
  • eval_accumulation_steps: None
  • include_for_metrics: []
  • batch_eval_metrics: False
  • save_only_model: False
  • save_on_each_node: False
  • enable_jit_checkpoint: False
  • push_to_hub: False
  • hub_private_repo: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_always_push: False
  • hub_revision: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • restore_callback_states_from_checkpoint: False
  • full_determinism: False
  • seed: 12
  • data_seed: None
  • use_cpu: False
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • parallelism_config: None
  • dataloader_drop_last: True
  • dataloader_num_workers: 0
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • dataloader_prefetch_factor: None
  • remove_unused_columns: True
  • label_names: None
  • train_sampling_strategy: random
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • ddp_static_graph: None
  • ddp_backend: None
  • ddp_timeout: 1800
  • fsdp: None
  • fsdp_config: None
  • deepspeed: None
  • debug: []
  • skip_memory_metrics: True
  • do_predict: False
  • resume_from_checkpoint: None
  • warmup_ratio: None
  • local_rank: -1
  • prompts: None
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: proportional
  • router_mapping: {}
  • learning_rate_mapping: {}

Training Logs

Click to expand
Epoch Step Training Loss Validation Loss
0.5712 34010 0.6607 -
0.5713 34020 0.6628 -
0.5715 34030 0.6633 -
0.5717 34040 0.6620 -
0.5718 34050 0.6622 -
0.5720 34060 0.6639 -
0.5722 34070 0.6647 -
0.5723 34080 0.6631 -
0.5725 34090 0.6640 -
0.5727 34100 0.6652 -
0.5728 34110 0.6622 -
0.5730 34120 0.6623 -
0.5732 34130 0.6607 -
0.5733 34140 0.6638 -
0.5735 34150 0.6656 -
0.5737 34160 0.6634 -
0.5738 34170 0.6635 -
0.5740 34180 0.6636 -
0.5742 34190 0.6635 -
0.5743 34200 0.6643 -
0.5745 34210 0.6638 -
0.5747 34220 0.6656 -
0.5748 34230 0.6645 -
0.5750 34240 0.6639 -
0.5752 34250 0.6618 -
0.5754 34260 0.6629 -
0.5755 34270 0.6614 -
0.5757 34280 0.6641 -
0.5759 34290 0.6601 -
0.5760 34300 0.6646 -
0.5762 34310 0.6610 -
0.5764 34320 0.6624 -
0.5765 34330 0.6616 -
0.5767 34340 0.6623 -
0.5769 34350 0.6602 -
0.5770 34360 0.6609 -
0.5772 34370 0.6630 -
0.5774 34380 0.6644 -
0.5775 34390 0.6652 -
0.5777 34400 0.6643 -
0.5779 34410 0.6634 -
0.5780 34420 0.6631 -
0.5782 34430 0.6612 -
0.5784 34440 0.6590 -
0.5785 34450 0.6621 -
0.5787 34460 0.6622 -
0.5789 34470 0.6659 -
0.5790 34480 0.6614 -
0.5792 34490 0.6621 -
0.5794 34500 0.6625 -
0.5796 34510 0.6601 -
0.5797 34520 0.6600 -
0.5799 34530 0.6593 -
0.5801 34540 0.6630 -
0.5802 34550 0.6609 -
0.5804 34560 0.6641 -
0.5806 34570 0.6631 -
0.5807 34580 0.6658 -
0.5809 34590 0.6615 -
0.5811 34600 0.6594 -
0.5812 34610 0.6611 -
0.5814 34620 0.6633 -
0.5816 34630 0.6605 -
0.5817 34640 0.6627 -
0.5819 34650 0.6634 -
0.5821 34660 0.6587 -
0.5822 34670 0.6641 -
0.5824 34680 0.6626 -
0.5826 34690 0.6610 -
0.5827 34700 0.6615 -
0.5829 34710 0.6628 -
0.5831 34720 0.6619 -
0.5832 34730 0.6618 -
0.5834 34740 0.6622 -
0.5836 34750 0.6615 -
0.5838 34760 0.6608 -
0.5839 34770 0.6619 -
0.5841 34780 0.6624 -
0.5843 34790 0.6628 -
0.5844 34800 0.6659 -
0.5846 34810 0.6617 -
0.5848 34820 0.6616 -
0.5849 34830 0.6628 -
0.5851 34840 0.6632 -
0.5853 34850 0.6618 -
0.5854 34860 0.6644 -
0.5856 34870 0.6616 -
0.5858 34880 0.6577 -
0.5859 34890 0.6652 -
0.5861 34900 0.6618 -
0.5863 34910 0.6589 -
0.5864 34920 0.6636 -
0.5866 34930 0.6630 -
0.5868 34940 0.6636 -
0.5869 34950 0.6635 -
0.5871 34960 0.6602 -
0.5873 34970 0.6608 -
0.5874 34980 0.6610 -
0.5876 34990 0.6573 -
0.5878 35000 0.6609 0.6583
0.5879 35010 0.6613 -
0.5881 35020 0.6592 -
0.5883 35030 0.6625 -
0.5885 35040 0.6622 -
0.5886 35050 0.6617 -
0.5888 35060 0.6583 -
0.5890 35070 0.6636 -
0.5891 35080 0.6603 -
0.5893 35090 0.6605 -
0.5895 35100 0.6595 -
0.5896 35110 0.6626 -
0.5898 35120 0.6607 -
0.5900 35130 0.6612 -
0.5901 35140 0.6591 -
0.5903 35150 0.6629 -
0.5905 35160 0.6617 -
0.5906 35170 0.6598 -
0.5908 35180 0.6603 -
0.5910 35190 0.6620 -
0.5911 35200 0.6606 -
0.5913 35210 0.6619 -
0.5915 35220 0.6617 -
0.5916 35230 0.6578 -
0.5918 35240 0.6616 -
0.5920 35250 0.6609 -
0.5921 35260 0.6586 -
0.5923 35270 0.6642 -
0.5925 35280 0.6620 -
0.5927 35290 0.6614 -
0.5928 35300 0.6586 -
0.5930 35310 0.6614 -
0.5932 35320 0.6613 -
0.5933 35330 0.6618 -
0.5935 35340 0.6614 -
0.5937 35350 0.6599 -
0.5938 35360 0.6612 -
0.5940 35370 0.6600 -
0.5942 35380 0.6595 -
0.5943 35390 0.6603 -
0.5945 35400 0.6613 -
0.5947 35410 0.6581 -
0.5948 35420 0.6607 -
0.5950 35430 0.6642 -
0.5952 35440 0.6584 -
0.5953 35450 0.6601 -
0.5955 35460 0.6592 -
0.5957 35470 0.6608 -
0.5958 35480 0.6594 -
0.5960 35490 0.6600 -
0.5962 35500 0.6600 -
0.5963 35510 0.6613 -
0.5965 35520 0.6594 -
0.5967 35530 0.6616 -
0.5968 35540 0.6652 -
0.5970 35550 0.6634 -
0.5972 35560 0.6603 -
0.5974 35570 0.6558 -
0.5975 35580 0.6606 -
0.5977 35590 0.6602 -
0.5979 35600 0.6619 -
0.5980 35610 0.6600 -
0.5982 35620 0.6591 -
0.5984 35630 0.6617 -
0.5985 35640 0.6564 -
0.5987 35650 0.6646 -
0.5989 35660 0.6624 -
0.5990 35670 0.6611 -
0.5992 35680 0.6589 -
0.5994 35690 0.6578 -
0.5995 35700 0.6632 -
0.5997 35710 0.6598 -
0.5999 35720 0.6611 -
0.6000 35730 0.6632 -
0.6002 35740 0.6635 -
0.6004 35750 0.6626 -
0.6005 35760 0.6625 -
0.6007 35770 0.6601 -
0.6009 35780 0.6605 -
0.6010 35790 0.6604 -
0.6012 35800 0.6593 -
0.6014 35810 0.6584 -
0.6016 35820 0.6632 -
0.6017 35830 0.6604 -
0.6019 35840 0.6580 -
0.6021 35850 0.6622 -
0.6022 35860 0.6613 -
0.6024 35870 0.6621 -
0.6026 35880 0.6576 -
0.6027 35890 0.6597 -
0.6029 35900 0.6590 -
0.6031 35910 0.6637 -
0.6032 35920 0.6568 -
0.6034 35930 0.6625 -
0.6036 35940 0.6587 -
0.6037 35950 0.6608 -
0.6039 35960 0.6583 -
0.6041 35970 0.6633 -
0.6042 35980 0.6604 -
0.6044 35990 0.6633 -
0.6046 36000 0.6605 0.6565

Training Time

  • Training: 11.4 minutes
  • Evaluation: 1.0 seconds
  • Total: 11.4 minutes

Framework Versions

  • Python: 3.12.13
  • Sentence Transformers: 5.7.0
  • Transformers: 5.13.1
  • PyTorch: 2.10.0+cu128
  • Accelerate: 1.14.0
  • Datasets: 5.0.1
  • Tokenizers: 0.22.2

Additional Resources

Citation

BibTeX

Sentence Transformers 

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

EmbedDistillLoss 

@article{kim2023embeddistill,
    title={EmbedDistill: A Geometric Knowledge Distillation for Information Retrieval},
    author={Kim, Seungyeon and Rawat, Ankit Singh and Zaheer, Manzil and Jayasumana, Sadeep and Sadhanala, Veeranjaneyulu and Jitkrittum, Wittawat and Menon, Aditya Krishna and Fergus, Rob and Kumar, Sanjiv},
    year={2023},
    eprint={2301.12005},
    archivePrefix={arXiv},
    primaryClass={cs.IR}
}
Downloads last month
-
Safetensors
Model size
35.1M params
Tensor type
F32
·
Inference Providers NEW
Sentence Similarity
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for much1na/distil-cohere-l2-ckpt

Base model

google/bert_uncased_L-6_H-512_A-8
Finetuned
(5)
this model

Papers for much1na/distil-cohere-l2-ckpt