Model: lemon-mint/KoEn-Embed-Turbo-v0.7-final
Author: lemon-mint
Pipeline: sentence-similarity
Library: sentence-transformers
Tags: sentence-transformers, safetensors, bert, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:499500, loss:MSELoss, arxiv:1908.10084, arxiv:2004.09813, base_model:lemon-mint/KoEn-Embed-Turbo-v0.6, base_model:finetune:lemon-mint/KoEn-Embed-Turbo-v0.6, model-index, text-embeddings-inference, endpoints_compatible, region:us
Base models (finetune): id: lemon-mint/KoEn-Embed-Turbo-v0.6
Card metadata: library_name: sentence-transformers
tags: sentence-transformers, sentence-similarity, feature-extraction, generated_from_trainer, dataset_size:499500, loss:MSELoss
base_model: lemon-mint/KoEn-Embed-Turbo-v0.6
metrics: pearson_cosine, spearman_cosine, pearson_manhattan, spearman_manhattan, pearson_euclidean, spearman_euclidean, pearson_dot, spearman_dot, pearson_max, spearman_max, cosine_accuracy@1, cosine_accuracy@3, cosine_accuracy@5, cosine_accuracy@10, cosine_precision@1, cosine_precision@3, cosine_precision@5, cosine_precision@10, cosine_recall@1, cosine_recall@3, cosine_recall@5, cosine_recall@10, cosine_ndcg@10, cosine_mrr@10, cosine_map@100, dot_accuracy@1, dot_accuracy@3, dot_accuracy@5, dot_accuracy@10, dot_precision@1, dot_precision@3, dot_precision@5, dot_precision@10, dot_recall@1, dot_recall@3, dot_recall@5, dot_recall@10, dot_ndcg@10, dot_mrr@10, dot_map@100
widget: source_sentence: query: 순드리 우탐찬다니의 대표적인 단편 소설은 무엇입니까?
sentences: query: What works have been influenced by "Fourth World"?, query: 학교 건물의 건축 스타일은 무엇입니까?, query: Which group of people's experiences did the JERS study aim to document?, source_sentence: query: 비센테 게레로 시정촌의 주요 산업은 무엇입니까?
sentences: query: 캐나다의 지방 선거는 어떤 주체가 관할합니까?, query: 2024년 네브래스카주 상원 특별 선거에서 승리할 것으로 예상되는 후보는 누구입니까?, query: 라말링게슈와라 사원 단지에 있는 사원들은 모두 같은 시대에 지어졌습니까?, source_sentence: query: 세인트 존의 부인은 결혼 전에 어떤 직업을 가졌습니까?
sentences: query: What led to amateur astronomy becoming an independent hobby activity distinct from professional astronomy?, query: HIK 학교는 어떤 시대에 설립되었나요?, query: 호주에서 "스쿼터"가 된 사람들은 대부분 어떤 계층의 사람들이었나요?, source_sentence: query: How many home runs did Eddie Mathews hit in 1957?
sentences: query: How long did Major live in the White House?, query: How many points did Lithuania receive in the Eurovision Song Contest semi-final in 2005?, query: Why did Loretta Tupper return to show business?, source_sentence: query: 해롤드 데이비스는 어떤 국가의 선수였나요?
sentences: query: 릴리는 어떤 스포츠를 좋아했습니까?, query: 안토니오 데 카스트로 마이어는 1988년에 어떤 행위로 인해 논란을 일으켰습니까?, query: When was the Herefordshire Light Infantry founded?
pipeline_tag: sentence-similarity
model-index: name: SentenceTransformer based on lemon-mint/KoEn-Embed-Turbo-v0.6
results: task: type: semantic-similarity
name: Semantic Similarity
dataset: name: sts dev
type: sts-dev
metrics: type: pearson_cosine
value: 0.7166865142404676
name: Pearson Cosine
verified: no, type: spearman_cosine
value: 0.7179436638586734
name: Spearman Cosine
verified: no, type: pearson_manhattan
value: 0.6562645352982684
name: Pearson Manhattan
verified: no, type: spearman_manhattan
value: 0.6713564101735439
name: Spearman Manhattan
verified: no, type: pearson_euclidean
value: 0.6576343568691049
name: Pearson Euclidean
verified: no, type: spearman_euclidean
value: 0.6720055780017863
name: Spearman Euclidean
verified: no, type: pearson_dot
value: 0.581317643897043
name: Pearson Dot
verified: no, type: spearman_dot
value: 0.6227048224971706
name: Spearman Dot
verified: no, type: pearson_max
value: 0.7166865142404676
name: Pearson Max
verified: no, type: spearman_max
value: 0.7179436638586734
name: Spearman Max
verified: no, task: type: information-retrieval
name: Information Retrieval
dataset: name: Ko StrategyQA dev
type: Ko-StrategyQA-dev
metrics: type: cosine_accuracy@1
value: 0.16722972972972974
name: Cosine Accuracy@1
verified: no, type: cosine_accuracy@3
value: 0.25844594594594594
name: Cosine Accuracy@3
verified: no, type: cosine_accuracy@5
value: 0.30236486486486486
name: Cosine Accuracy@5
verified: no, type: cosine_accuracy@10
value: 0.38006756756756754
name: Cosine Accuracy@10
verified: no, type: cosine_precision@1
value: 0.16722972972972974
name: Cosine Precision@1
verified: no, type: cosine_precision@3
value: 0.09853603603603603
name: Cosine Precision@3
verified: no, type: cosine_precision@5
value: 0.07128378378378379
name: Cosine Precision@5
verified: no, type: cosine_precision@10
value: 0.04746621621621622
name: Cosine Precision@10
verified: no, type: cosine_recall@1
value: 0.10484234234234234
name: Cosine Recall@1
verified: no, type: cosine_recall@3
value: 0.1760698198198198
name: Cosine Recall@3
verified: no, type: cosine_recall@5
value: 0.21348536036036034
name: Cosine Recall@5
verified: no, type: cosine_recall@10
value: 0.27516891891891887
name: Cosine Recall@10
verified: no, type: cosine_ndcg@10
value: 0.20750097993183542
name: Cosine Ndcg@10
verified: no, type: cosine_mrr@10
value: 0.22642307486057478
name: Cosine Mrr@10
verified: no, type: cosine_map@100
value: 0.1760894166796981
name: Cosine Map@100
verified: no, type: dot_accuracy@1
value: 0.13682432432432431
name: Dot Accuracy@1
verified: no, type: dot_accuracy@3
value: 0.2195945945945946
name: Dot Accuracy@3
verified: no, type: dot_accuracy@5
value: 0.2635135135135135
name: Dot Accuracy@5
verified: no, type: dot_accuracy@10
value: 0.33952702702702703
name: Dot Accuracy@10
verified: no, type: dot_precision@1
value: 0.13682432432432431
name: Dot Precision@1
verified: no, type: dot_precision@3
value: 0.08614864864864864
name: Dot Precision@3
verified: no, type: dot_precision@5
value: 0.06317567567567568
name: Dot Precision@5
verified: no, type: dot_precision@10
value: 0.043243243243243246
name: Dot Precision@10
verified: no, type: dot_recall@1
value: 0.09127252252252252
name: Dot Recall@1
verified: no, type: dot_recall@3
value: 0.1596846846846847
name: Dot Recall@3
verified: no, type: dot_recall@5
value: 0.1899493243243243
name: Dot Recall@5
verified: no, type: dot_recall@10
value: 0.2541103603603604
name: Dot Recall@10
verified: no, type: dot_ndcg@10
value: 0.18669639273900773
name: Dot Ndcg@10
verified: no, type: dot_mrr@10
value: 0.19339473401973398
name: Dot Mrr@10
verified: no, type: dot_map@100
value: 0.15927201068719438
name: Dot Map@100
verified: no, task: type: semantic-similarity
name: Semantic Similarity
dataset: name: sts test
type: sts-test
metrics: type: pearson_cosine
value: 0.6269313573543648
name: Pearson Cosine
verified: no, type: spearman_cosine
value: 0.6185961220418067
name: Spearman Cosine
verified: no, type: pearson_manhattan
value: 0.578738833621439
name: Pearson Manhattan
verified: no, type: spearman_manhattan
value: 0.5839976753348799
name: Spearman Manhattan
verified: no, type: pearson_euclidean
value: 0.5793449665959343
name: Pearson Euclidean
verified: no, type: spearman_euclidean
value: 0.5843842345712776
name: Spearman Euclidean
verified: no, type: pearson_dot
value: 0.4781712564220267
name: Pearson Dot
verified: no, type: spearman_dot
value: 0.5057919404595702
name: Spearman Dot
verified: no, type: pearson_max
value: 0.6269313573543648
name: Pearson Max
verified: no, type: spearman_max
value: 0.6185961220418067
name: Spearman Max
verified: no
Likes: 0 | All-time downloads: 1
Created: 2024-07-01 01:47:52