Datasets:

huggingface

/

datatrove-tests

like 0

Datasets used for datatrove testing. Each split contains the same data:

dst = [
    {"text": "hello"},
    {"text": "world"},
    {"text": "how"},
    {"text": "are"},
    {"text": "you"},
]

But based on the split name the data are sharded into n-bins