File size: 1,713 Bytes
b547a07 4bec69e b547a07 4bec69e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
---
language:
- en
datasets:
- simpeval
tags:
- simplification
license: apache-2.0
---
This contains the trained checkpoint for LENS-SALSA, as introduced in [**Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA**](https://arxiv.org/abs/2305.14458). For more information, please refer to the [**SALSA repository**](https://github.com/davidheineman/salsa).
```bash
pip install lens-metric
```
```python
from lens import download_model
from lens.lens_salsa import LENS_SALSA
model_path = download_model("davidheineman/lens-salsa")
lens_salsa = LENS_SALSA(model_path)
score = lens_salsa.score(
complex = [
"They are culturally akin to the coastal peoples of Papua New Guinea."
],
simple = [
"They are culturally similar to the people of Papua New Guinea."
]
)
```
## Intended uses
Our model is intented to be used for **reference-free simplification evaluation**. Given a source text and its translation, outputs a single score between 0 and 1 where 1 represents a perfect simplification and 0 a random simplification. LENS-SALSA was trained on edit annotations of the SimpEval dataset, which covers manually-written, complex Wikipedia simplifications. We have not evaluated our model on non-English languages or non-Wikipedia domains.
## Cite SALSA
If you find our paper, code or data helpful, please consider citing [**our work**](https://arxiv.org/abs/2305.14458):
```tex
@article{heineman2023dancing,
title={Dancing {B}etween {S}uccess and {F}ailure: {E}dit-level {S}implification {E}valuation using {SALSA}},
author = "Heineman, David and Dou, Yao and Xu, Wei",
journal={arXiv preprint arXiv:2305.14458},
year={2023}
}
```
|