Temperature for Benchmark
#3
by
backendmagier
- opened
Hello again,
have you used any specific temperature for the TruthfulQA Benchmark?
Many Thanks in Advance!
Hi @backendmagier It uses the lm-eval-harness library, and by default uses a temperature of 0 for that benchmark
alright, thank you!
backendmagier
changed discussion status to
closed