Currupt?
Title, the model gives this error on a known good setup, it might be from a bad upload.
Traceback (most recent call last):
File "/home/del/nyx/text-generation-webui/modules/callbacks.py", line 56, in gentask
ret = self.mfunc(callback=_callback, *args, **self.kwargs)
File "/home/del/nyx/text-generation-webui/modules/text_generation.py", line 347, in generate_with_callback
shared.model.generate(**kwargs)
File "/home/del/anaconda3/envs/oogen/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/home/del/anaconda3/envs/oogen/lib/python3.10/site-packages/transformers/generation/utils.py", line 1648, in generate
return self.sample(
File "/home/del/anaconda3/envs/oogen/lib/python3.10/site-packages/transformers/generation/utils.py", line 2766, in sample
next_tokens = torch.multinomial(probs, num_samples=1).squeeze(1)
RuntimeError: probability tensor contains either inf, nan or element < 0
Output generated in 1.54 seconds (0.00 tokens/s, 0 tokens, context 380, seed 1394196721)