bigscience

/

bloom

like 4.57k

This is my code:

def query(payload):
    response = requests.post(API_URL, headers=headers, json=payload)
    return response.json()

output = query({"inputs": promt, "do_sample": True})

Strangeley, adding the "do sample" part in the query's arguments doesnt change anything. The answers are always the same with the same promt too, but I want some variation. Anyone know what Im doing wrong?