chargoddard commited on
Commit
e65c456
1 Parent(s): 3014199

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ [01-ai/Yi-34B](https://huggingface.co/01-ai/Yi-34B/tree/main) with tensors renamed to match standard Llama modelling code. Model can be loaded without trust_remote_code, but the tokenizer can not.
2
+
3
+ The branch `llama-tokenizer` uses the Llama tokenizer class as well, but *does not* work with LlamaTokenizerFast.