Spaces:

tiiuae

/

falcon-180b-demo

like 932

Running

I'm not sure if I understand your comment but you can use the space as an API with gradio_client. The following code should help:

from gradio_client import Client

client = Client("tiiuae/falcon-180b-demo")
result = client.predict("Howdy!", "You are a helpful assistant", 0.9, 256, 0.9, 1.2)
print(result)

Here are the parameters for the predict function:

predict(message, optional_system_prompt, temperature, max_new_tokens, topp_nucleus_sampling, repetition_penalty)