Spaces:

tiiuae

/

falcon-180b-demo

like 961

Running

This code should fix your problems:

from gradio_client import Client

client = Client("tiiuae/falcon-180b-demo")
result = client.predict("Howdy!", "You are a helpful assistant", 0.9, 256, 0.9, 1.2)
print(result)

Here are the parameters for the predict function:

predict(message, optional_system_prompt, temperature, max_new_tokens, topp_nucleus_sampling, repetition_penalty)

@Techpro864 VER VERY THANKS!! IT WORKED

But how do I add the history thing, or do we have to do it ourselves using another script that does that?

You have to add that yourself because the only function is predict and there is no way to pass in message history.

Oh alright, i already did it lmao 🤣