IanLi233
/

Cautious_Qwen

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Ian Li commited on 16 days ago

Commit

709b5d7

•

1 Parent(s): 4c42116

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -40,7 +40,7 @@ This is the model card of a 🤗 transformers model that has been pushed on the
 <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 ```
-max_seq_length = 2048 # Choose any! We auto support RoPE Scaling internally!
 dtype = None # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+
 load_in_4bit = True # Use 4bit quantization to reduce memory usage. Can be False.

 <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 ```
+max_seq_length = 2048 # Choose any! Unsloth auto support RoPE Scaling internally!
 dtype = None # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+
 load_in_4bit = True # Use 4bit quantization to reduce memory usage. Can be False.