Upload folder using huggingface_hub

.gitattributes

@@ -40,3 +40,8 @@ s3nh-Noromaid-Aeryth-7B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 s3nh-Noromaid-Aeryth-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 s3nh-Noromaid-Aeryth-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 s3nh-Noromaid-Aeryth-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+noromaid-aeryth-7b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+noromaid-aeryth-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+noromaid-aeryth-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+noromaid-aeryth-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+noromaid-aeryth-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -31,17 +31,16 @@ The key difference between GGJT and GGUF is the use of a key-value structure for
 This allows for new metadata to be added without breaking compatibility with existing models, and to annotate the model with additional information that may be useful for
 inference or for identifying the model.
 
-### Perplexity params
 
-Model	Measure	Q2_K	Q3_K_S	Q3_K_M	Q3_K_L	Q4_0	Q4_1	Q4_K_S	Q4_K_M	Q5_0	Q5_1	Q5_K_S	Q5_K_M	Q6_K	Q8_0	F16
-7B	perplexity	6.7764	6.4571	6.1503	6.0869	6.1565	6.0912	6.0215	5.9601	5.9862	5.9481	5.9419	5.9208	5.9110	5.9070	5.9066
-13B	perplexity	5.8545	5.6033	5.4498	5.4063	5.3860	5.3608	5.3404	5.3002	5.2856	5.2706	5.2785	5.2638	5.2568	5.2548	5.2543
 
+### inference 
 
 
-### inference 
+ User: Tell me story about what is an quantization and what do we need to build. Quantization is the process of mapping continuous data to discrete values. This technique is commonly used in signal processing, image compression, and computer graphics to reduce the amount of data while maintaining the essential information.
 
+To build a quantization system, we need several key components:
 
-TODO
+1. Data acquisition: The first step in building a quantization system is to acquire the continuous data that you want to quantize. This could be data from a microphone, a temperature sensor, or any other type of sensor that can provide continuous data.
+2. Preprocessing: Once you have acquired the continuous data, the next step is to
 
 # Original model card

noromaid-aeryth-7b.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93bc80c1af49ba88ec586f84f06d3209f926bd7db44b4a59d3278a6bbf8e5b6d
+size 3164567296

noromaid-aeryth-7b.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b72f2a5640b90362f8b2cd8fd5eeae6613f5f1067a7e7bdfa0fcb8a16a7530e9
+size 4368439040

noromaid-aeryth-7b.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee58d9ff79bca59f60a54ee35331a288fcb2bfce42d6f9bf06759534b32eaeac
+size 5131409152

noromaid-aeryth-7b.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d56801c34b5cd942ae502898a2382cf8287c8935da633135cccd93cc490e8a6d
+size 5942064896

noromaid-aeryth-7b.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3393f72c0096b37aa0ac7b56db99214a67db7a2156e8e3f11ba651b7e89a2ced
+size 7695857408