Image-Colour-Extract / tokenizer.py
adi0308's picture
Upload 3 files
1bbd364
raw
history blame contribute delete
66 Bytes
def tokenizer_function(text):
return text.strip().split('\n')