Llamacpp quants

.gitattributes

@@ -33,3 +33,19 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Hyperion-3.0-Mistral-7B-DPO-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Hyperion-3.0-Mistral-7B-DPO-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd26c7e83bf842c6b7ff6dbc9bc046bb9f8efcb0bc35238c002ccb532ed9d6da
+size 3284891424

Hyperion-3.0-Mistral-7B-DPO-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:558034c0436944695fddb48489a38e19ae7f548d858f92b71ebf049b073cca69
+size 3182393120

Hyperion-3.0-Mistral-7B-DPO-IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2837f0b0e7feab957a33f6d1e2072d7f6d584b8651cf8c3d6d94d61fa58ce6f
+size 4155053856

Hyperion-3.0-Mistral-7B-DPO-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c3445e200f6aed019ea03ae0d404571f8240dd39221f6bdec22c75b0cf64a641
+size 3944388384

Hyperion-3.0-Mistral-7B-DPO-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78c1fc1a9e6524d9d96c4fe0f1279b2f07eb0b94d79023db9dd5445cc1dcb71d
+size 2719242016

Hyperion-3.0-Mistral-7B-DPO-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3fd3f74a3aad565d5b234685ec3bfcc679cd0dfd5b3de657705e4e761fcdad3f
+size 3822024480

Hyperion-3.0-Mistral-7B-DPO-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d73d704887bc9c2b2a8b7a77c18effada3e03d34f16628ece265a9a367ec35ff
+size 3518986016

Hyperion-3.0-Mistral-7B-DPO-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a24072a0a23fc6d7bd42bbcbcec75ff923a6bcd0cb75c2581a7be25f95abf6d
+size 3164567328

Hyperion-3.0-Mistral-7B-DPO-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:006b61dc7f81b77b94fb2cf1e2360aa1494fa4fb3493c8659ebb97b2237f4e4d
+size 4108916512

Hyperion-3.0-Mistral-7B-DPO-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca940feaf8419b39c0683ec1cca10815c60ce9f5dcbd2726e627a32814886ff4
+size 4368439072

Hyperion-3.0-Mistral-7B-DPO-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0a8986cd1a8d911b9686f07175fdaa01d38af38dc414d4e97eae3f91c1eb1b0
+size 4140373792

Hyperion-3.0-Mistral-7B-DPO-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f750298efd33b4c4b00725e0baab0fa281b6fdc02af94c0231522ba44a9e97d
+size 4997715744

Hyperion-3.0-Mistral-7B-DPO-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7529a5f0d24ec06f14a099c8c350c2dc5190cda750e5740dadc22a9778c9b05d
+size 5131409184

Hyperion-3.0-Mistral-7B-DPO-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e729be2a21632c1b082ba7d81fd7b141873f069cab6e0f1ed16156287dff4419
+size 4997715744

Hyperion-3.0-Mistral-7B-DPO-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:724a9c8ba9b9eb625a02a48fbed361218a981914b0747c0c3d7beadae6e7cd6d
+size 5942064928

Hyperion-3.0-Mistral-7B-DPO-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cef6fdc1c118fb2f5e99b1edce297b9a77448d5fa49d9a7febb8daf02c3ed74b
+size 7695857440

README.md

@@ -0,0 +1,121 @@
+---
+library_name: transformers
+license: apache-2.0
+language:
+- en
+widget:
+- example_title: Reasoning
+  text: >
+    <|im_start|>system
+
+    You are Hyperion, an AI assistant developed by Sebastian Gabarain with a
+    focus in reasoning, coding, science, and other general-purpose subjects. You
+    are an AI assistant that follows instruction extremely well. Help as much as
+    you can.
+
+    <|im_end|>
+
+    <|im_start|>user
+
+    In this task, you are given a description of an object and its surroundings.
+    Your
+
+    task is to describe the motion of the object mentioned in the description
+    using
+
+    differential equations. The answer should be a mathematical expression in t.
+    Description:
+
+    A ball is thrown up at 30 ft/sec from 3 feet off the ground. Solve this
+    step-by-step,
+
+    explaining each step in detail.
+
+    <|im_end|>
+
+    <|im_start|>assistant
+  output:
+    text: >
+      Hyperion here. The task requires you to describe the motion of a ball
+      thrown up using differential equations. Here's the detailed explanation of
+      how to solve it:
+
+
+      1. Identify the given information:
+         - Initial velocity (v0): 30 ft/sec
+         - Initial height (y0): 3 feet off the ground
+
+      2. Determine the acceleration due to gravity (g) at sea level, which is
+      approximately -32.2 ft/s^2. Since we're dealing with a short distance and
+      not very high altitudes, we can consider this value of g as constant.
+
+
+      3. Use Newton's second law of motion to find the differential equation
+      that describes the motion:
+         - The net force acting on the ball is the sum of gravity (mg) and air resistance (which we will neglect for simplicity). So, Fnet = mg.
+         - Since acceleration equals force divided by mass, a = Fnet/m. In this case, m cancels out, so a = g.
+         - The motion equation becomes: dv/dt = g = -32.2 ft/s^2 (since we're moving upwards). This is the first differential equation.
+
+      4. Since we want to describe the ball's position (y) as well, we need
+      another differential equation. We can use kinematics equations:
+         - The velocity equation is v = v0 + at. Substitute the value of a from step 3:
+           dv/dt = -32.2 ft/s^2. Rewriting it as an integral:
+            ∫dv = -32.2 ft/s^2 * dt
+         - Integrating with respect to time, we get v(t) = -16.1 t + C (constant of integration).
+
+      5. Now we have two equations, one for velocity and another for position:
+         - dv/dt = -32.2 ft/s^2 (equation 1)
+         - v(t) = -16.1 t + C (equation 2)
+
+      6. We need to find the constant C using the initial conditions given in
+      the problem. We know that initially, at time t=0, the ball's velocity is
+      v0:
+         - Equation 2 becomes v0 = -16.1 * 0 + C, which simplifies to C = v0 = 30 ft/sec (initial velocity).
+
+      7. Now we have both equations with the constants filled in:
+         - dv/dt = -32.2 ft/s^2 (equation 1)
+         - v(t) = -16.1 t + 30 ft/sec (equation 2)
+
+      8. Finally, we need to find the ball's position (y) as a function of time:
+         - Use the second kinematics equation y = y0 + v0*t + ½*a*t^2 (since acceleration is constant, it can be moved outside the integral).
+         - Substitute the values for v0 and a:
+           y(t) = 3 ft + (30 ft/sec) * t + (-½ * 32.2 ft/s^2) * t^2
+
+      That's it! The differential equation describing the motion of the ball is:
+         - dv/dt = -32.2 ft/s^2 (equation 1)
+         - v(t) = -16.1 t + 30 ft/sec (equation 2)
+         - y(t) = 3 ft + (30 ft/sec) * t - (16.1 t^2) ft (equation 3)
+datasets:
+- Locutusque/hyperion-dpo-v1.0
+quantized_by: bartowski
+pipeline_tag: text-generation
+---
+
+## Llamacpp Quantizations of Hyperion-3.0-Mistral-7B-DPO
+
+Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b2440">b2440</a> for quantization.
+
+Original model: https://huggingface.co/Locutusque/Hyperion-3.0-Mistral-7B-DPO
+
+Download a file (not the whole branch) from below:
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Hyperion-3.0-Mistral-7B-DPO-Q8_0.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q8_0.gguf) | Q8_0 | 7.69GB | Extremely high quality, generally unneeded but max available quant. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q6_K.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q6_K.gguf) | Q6_K | 5.94GB | Very high quality, near perfect, *recommended*. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q5_K_M.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q5_K_M.gguf) | Q5_K_M | 5.13GB | High quality, very usable. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q5_K_S.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q5_K_S.gguf) | Q5_K_S | 4.99GB | High quality, very usable. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q5_0.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q5_0.gguf) | Q5_0 | 4.99GB | High quality, older format, generally not recommended. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q4_K_M.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q4_K_M.gguf) | Q4_K_M | 4.36GB | Good quality, similar to 4.25 bpw. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q4_K_S.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q4_K_S.gguf) | Q4_K_S | 4.14GB | Slightly lower quality with small space savings. |
+| [Hyperion-3.0-Mistral-7B-DPO-IQ4_NL.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-IQ4_NL.gguf) | IQ4_NL | 4.15GB | Good quality, similar to Q4_K_S, new method of quanting, |
+| [Hyperion-3.0-Mistral-7B-DPO-IQ4_XS.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-IQ4_XS.gguf) | IQ4_XS | 3.94GB | Decent quality, new method with similar performance to Q4. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q4_0.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q4_0.gguf) | Q4_0 | 4.10GB | Decent quality, older format, generally not recommended. |
+| [Hyperion-3.0-Mistral-7B-DPO-IQ3_M.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-IQ3_M.gguf) | IQ3_M | 3.28GB | Medium-low quality, new method with decent performance. |
+| [Hyperion-3.0-Mistral-7B-DPO-IQ3_S.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-IQ3_S.gguf) | IQ3_S | 3.18GB | Lower quality, new method with decent performance, recommended over Q3 quants. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q3_K_L.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q3_K_L.gguf) | Q3_K_L | 3.82GB | Lower quality but usable, good for low RAM availability. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q3_K_M.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q3_K_M.gguf) | Q3_K_M | 3.51GB | Even lower quality. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q3_K_S.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q3_K_S.gguf) | Q3_K_S | 3.16GB | Low quality, not recommended. |
+| [Hyperion-3.0-Mistral-7B-DPO-Q2_K.gguf](https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-DPO-GGUF/blob/main/Hyperion-3.0-Mistral-7B-DPO-Q2_K.gguf) | Q2_K | 2.71GB | Extremely low quality, *not* recommended.
+
+Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski