This model consistently prunes the last (or first I guess), value in numbers that repeat.
#4
by
KillrBee
- opened
from the log file:
{
"internal": [
[
"echo "10"",
"10"
],
[
"echo "11"",
"1"
],
[
"echo "12"",
"12"
],
[
"echo "122"",
"12"
],
[
"echo "1223"",
"123"
],
[
"write-out "122"",
"Twelve"
]
]
}
The model is the GPTQ model, loaded using ExLlama and ExLlama-HF. It works with the GPTQ loader:
[
"write-out "122"",
"One hundred and twenty-two"
],
[
"write-out "222"",
"Two hundred and twenty-two"
]