Preprocessing of text from gradio API

#16
by deathcrush - opened

Does anyone know whether formatting from the gradio gets preserved when passing the text to the tokenizer? For example, are newline characters interpreted as such, or are they stripped off and the tokenizer sees just a space delineated sequence of works? @osanseviero , any idea?

Actually, I think newlines are actually parsed as \n as far as I can see from playing with gr.Textbox inside colab.

deathcrush changed discussion status to closed

Sign up or log in to comment