bornjre
/

btlm-3b-ggml

Model card Files Files and versions Community

bornjre commited on Aug 5, 2023

Commit

c3979ad

·

1 Parent(s): 0e08f78

update ctx size

Files changed (1) hide show

btlm_model_wip.cpp +1 -1

btlm_model_wip.cpp CHANGED Viewed

@@ -168,7 +168,7 @@ bool btlm_model_load(const std::string &fname, btlm_model &model,
   {
-    ctx_size = 1024 * 1024 * 8000u; // fixme => actually calculate this
     printf("%s: ggml tensor size = %d bytes\n", __func__,
            (int)sizeof(ggml_tensor));

   {
+    ctx_size = 9000000000; // fixme => actually calculate this
     printf("%s: ggml tensor size = %d bytes\n", __func__,
            (int)sizeof(ggml_tensor));