Update app.py
Browse files
app.py
CHANGED
@@ -39,7 +39,6 @@ with demo:
|
|
39 |
gr.Markdown("<h1><center>Length generalization (LG) With BLOOM🌸 </center></h1>")
|
40 |
gr.Markdown(
|
41 |
"""
|
42 |
-
This Space is work in progress, BLOOM doesn't support inference on long sequencess so you may try with shorter sequences. \n
|
43 |
We will examine large language models ability to extrapolate to longer problems! \n
|
44 |
Length generalization (LG) is important: Often, long examples are rare and intrinsically more difficult, yet are the ones we care more about. \n
|
45 |
Recent paper [Exploring Length Generalization in Large Language Models](https://arxiv.org/pdf/2207.04901) found that using few-shot [scratchpad](https://arxiv.org/abs/2112.00114), a combo behind many strong LLM results (eg. #Minerva ) \n
|
@@ -47,6 +46,7 @@ with demo:
|
|
47 |
In-context learning enables variable length pattern matching, producing solutions of correct lengths. \n
|
48 |
This space is an attempt at inspecting this LLM behavior/capability in the new HuggingFace BigScienceW [Bloom](https://huggingface.co/bigscience/bloom) model. \n
|
49 |
This Space is created by [Muhtasham Oblokulov](https://twitter.com/muhtahsam9) for EuroPython 2022 Demo. \n
|
|
|
50 |
"""
|
51 |
)
|
52 |
with gr.Row():
|
|
|
39 |
gr.Markdown("<h1><center>Length generalization (LG) With BLOOM🌸 </center></h1>")
|
40 |
gr.Markdown(
|
41 |
"""
|
|
|
42 |
We will examine large language models ability to extrapolate to longer problems! \n
|
43 |
Length generalization (LG) is important: Often, long examples are rare and intrinsically more difficult, yet are the ones we care more about. \n
|
44 |
Recent paper [Exploring Length Generalization in Large Language Models](https://arxiv.org/pdf/2207.04901) found that using few-shot [scratchpad](https://arxiv.org/abs/2112.00114), a combo behind many strong LLM results (eg. #Minerva ) \n
|
|
|
46 |
In-context learning enables variable length pattern matching, producing solutions of correct lengths. \n
|
47 |
This space is an attempt at inspecting this LLM behavior/capability in the new HuggingFace BigScienceW [Bloom](https://huggingface.co/bigscience/bloom) model. \n
|
48 |
This Space is created by [Muhtasham Oblokulov](https://twitter.com/muhtahsam9) for EuroPython 2022 Demo. \n
|
49 |
+
This Space is work in progress, BLOOM doesn't support inference on long sequencess so you may try with shorter sequences. \n
|
50 |
"""
|
51 |
)
|
52 |
with gr.Row():
|