For text summary, how do I prevent hallucinations?
#13
by
JLouisBiz
- opened
I cannot get even one text summary out of it, is there way to prevent hallucinations? My settings below.
Updated Settings:
Predictions: 2048
Temperature: 0.5
Penalize Repeat Sequence: 1.1
Consider N Tokens for Penalize: 256
Top-K Sampling: 50
Top-P Sampling: 0.9
Min-P Sampling: 1
I don't see many hallucinations on a new GPU 3090 24 GB, that was the 1080 4 GB.
JLouisBiz
changed discussion status to
closed