sle-base
This is a model for the SLE metric described in the original paper. It is based on roberta-base
with an added regression head.
Install the python library.
SLE scores can be calculated within python as shown in the example below.
For a raw estimation of a sentence's simplicity, use 'sle'
, but to evaluate sentence simplification systems we recommend providing the input sentences and using 'sle_delta'
($\Delta \text{SLE}$). See the paper for further details.
from sle.scorer import SLEScorer
scorer = SLEScorer("liamcripwell/sle-base")
texts = [
"Here is a simple sentence.",
"Here is an additional sentence that makes use of more complex terminology."
]
# raw simplicity estimates
results = scorer.score(texts)
print(results) # {'sle': [3.9842946529388428, 0.5840105414390564]}
# delta from input sentences
results = scorer.score([texts[0]], inputs=[texts[1]])
print(results) # {'sle': [3.9842941761016846], 'sle_delta': [3.4002838730812073]}
- Downloads last month
- 201