Safetensors
Lithuanian
llama

Update tokenizer_config.json

#1
by papidipupui - opened

seems like a syntax error that causes:
JSONDecodeError: Expecting property name enclosed in double quotes: line 42 column 1 (char 1751)
when calling:
tokenizer = AutoTokenizer.from_pretrained("neurotechnology/Lt-Llama-2-7b-instruct-hf")

artena changed pull request status to merged

Sign up or log in to comment