add changelog

CHANGELOG.md

@@ -0,0 +1,8 @@
+
+## version： v20240318
+- train 12B tokens with 256k context window
+- recall of "Needle in A HayStack": 97.5%  [](./images/v20240318.png)
+
+## version: initial 
+- train 6B tokens with 256k context window
+- recall of "Needle in A HayStack": 87.1%  [](./images/initail.png)

md5

@@ -1,5 +1,5 @@
-dbdb0057bd6a45b21ac8a708b11b5ca1  model-00001-of-00004.safetensors
-8c21c8c0ec4642a5c957de7141c9dd6b  model-00002-of-00004.safetensors
-f30b358297910e8020ff9e19ac134a3e  model-00003-of-00004.safetensors
-f5f61561920649a6d2027b6a3956d3ec  model-00004-of-00004.safetensors
+c094e4db5e548ab603210c7f0f9c043c  model-00001-of-00004.safetensors
+d36fa3f98599e4525df3b725ac59d22b  model-00002-of-00004.safetensors
+104025593a3c23842391a01d62739456  model-00003-of-00004.safetensors
+3aba532f496b4835743074531c2dbfa1  model-00004-of-00004.safetensors
 291724ef50f729e45d68f474a7755bbc  tokenizer.model