OxxoCodes commited on
Commit
c72d6b4
1 Parent(s): 693b634

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ In its current state, this model has not yet been finetuned on long-context data. Do not use this model without performing additional pretraining, as performance will likely suffer.
2
+
3
+ Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here:
4
+ https://github.com/ccdv-ai/convert_checkpoint_to_lsg