Sentence Similarity
sentence-transformers
PyTorch
English
bert
feature-extraction
mteb
custom_code
Eval Results
6 papers
lodestone-base-4096-v1 / mteb_results /MTOPDomainClassification.json
dylanAtHum's picture
Initial Commit
64ae4c7 unverified
{
"dataset_revision": "d80d48c1eb48d3562165c59d59d0034df9fff0bf",
"mteb_dataset_name": "MTOPDomainClassification",
"mteb_version": "1.1.0",
"test": {
"en": {
"accuracy": 0.8966712266301871,
"accuracy_stderr": 0.009523011920085962,
"f1": 0.8957660424361247,
"f1_stderr": 0.009247170021662966,
"main_score": 0.8966712266301871
},
"evaluation_time": 7.75
},
"validation": {
"en": {
"accuracy": 0.9017002237136464,
"accuracy_stderr": 0.009890167527403295,
"f1": 0.9039792204701363,
"f1_stderr": 0.009182351003334687,
"main_score": 0.9017002237136464
},
"evaluation_time": 4.88
}
}