Odd responses

#3
by cooperdk - opened

This model gives responses like:

,; / C;

ATOTPO T) on to`;;;;; UN or; secret; ; T;O OF VOT /OT; specOR; TTM T c; /; T

TOT OF ones; OF T Ro

presITE

TOT of

C OF;,

/ COT OF H C

OT ski will

,/ doubt,;;

;OT; /

;,; b;

as / or; ; / or OT

vanOT or

T OF; / that

,

T to C) TOT; / OF

/

OF; or

,

T OF up /OT,;; T OF

OT)

, T / Qu

; /SEE or C T /

Please use the file koala-13B-4bit-128g.no-act-order.ooba.pt

The other ones require that you update to more recent GPTQ-for-LLaMa code

Sign up or log in to comment