Doesn't return any value using API? Model loaded successfully on runpod using The_Bloke's template

#4
by rafa9 - opened

The result shows just empty string like:

"{\"results\": [{\"text\": \"\"}]}"

The sent request is:

let request = {
    max_new_tokens: 500,
    do_sample: true,
    temperature: 0.3,
    top_p: 0.1,
    typical_p: 1,
    epsilon_cutoff: 0, // In units of 1e-4
    eta_cutoff: 0, // In units of 1e-4
    repetition_penalty: 1.18,
    top_k: 40,
    min_length: 10,
    no_repeat_ngram_size: 0,
    num_beams: 1,
    penalty_alpha: 0,
    length_penalty: 1,
    early_stopping: false,
    mirostat_mode: 0,
    mirostat_tau: 5,
    mirostat_eta: 0.1,
    seed: -1,
    add_bos_token: true,
    truncation_length: 2048,
    ban_eos_token: false,
    skip_special_tokens: true,
    stopping_strings: [],
  };

  request = {
    ...request,
    prompt: `Repeat this text please: "πŸŽƒ Hellow world how are you πŸ‘»"`,
  };
rafa9 changed discussion status to closed

You got it sorted?

Sign up or log in to comment