Thermostatic/rosettia-chanka-data huggingface dataset:
# AmericasNLP Quechua-Spanish Preprocess Report

Source: `https://github.com/AmericasNLP/americasnlp2024/tree/master/ST1_MachineTranslation/data/quechua-spanish`
Raw aligned rows loaded: 201,241
Unique normalized pairs: 194,665
High-quality real SFT rows: 87,004
High-quality real+synthetic SFT rows: 107,778
Evaluation rows: 996

## Subset Counts

source_subset,rows,high_quality_rows
dev,996,454
dict,8869,1209
extra,6230,4163
synthetic,59099,20774
train_jw300,119471,81632

## Filter Flag Counts

flag,len
weak_quechua_signal,74977
weak_spanish_signal,26383
too_short,17444
too_few_words,17321
extreme_length_ratio,8731
high_overlap_copy_risk,7319
empty_side,3851
exact_copy,3180
bracketed_metadata,1456
punct_or_numbers_only,1381
too_long,1004

## Caveat

AmericasNLP Quechua-Spanish is broad shared-task data. It includes `quy` resources, but it is not reviewed Chanka judicial-domain data.