mlc-ai
/

Hermes-2-Pro-Mistral-7B-q4f16_1-MLC

Model card Files Files and versions Community

riczhou commited on May 17

Commit

dc2593c

•

1 Parent(s): 58180aa

Update mlc-chat-config.json

Files changed (1) hide show

mlc-chat-config.json +1 -0

mlc-chat-config.json CHANGED Viewed

@@ -15,6 +15,7 @@
     "prefill_chunk_size": 2048,
     "attention_sink_size": 4,
     "tensor_parallel_shards": 1,
     "max_batch_size": 80
   },
   "vocab_size": 32032,

     "prefill_chunk_size": 2048,
     "attention_sink_size": 4,
     "tensor_parallel_shards": 1,
+    "context_window_size": -1,
     "max_batch_size": 80
   },
   "vocab_size": 32032,