stanrom
/

internlm-xcomposer2-7b-4bit

stanrom commited on May 23

Commit

601c786

•

1 Parent(s): 8ee9aef

Update configuration_internlm_xcomposer2.py

Files changed (1) hide show

configuration_internlm_xcomposer2.py CHANGED Viewed

@@ -108,7 +108,7 @@ class InternLMXcomposer2Config(PretrainedConfig):
         rope_theta=10000,
         rope_scaling=None,
         attn_implementation='eager',
-        device='cuda',
         # dtype='bfloat16',
         **kwargs,
     ):

         rope_theta=10000,
         rope_scaling=None,
         attn_implementation='eager',
+        device='cuda:0',
         # dtype='bfloat16',
         **kwargs,
     ):