Upload README.md with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,272 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
- fr
|
5 |
+
- de
|
6 |
+
- es
|
7 |
+
- it
|
8 |
+
- pt
|
9 |
+
- zh
|
10 |
+
- ja
|
11 |
+
- ru
|
12 |
+
- ko
|
13 |
+
license: other
|
14 |
+
license_name: mrl
|
15 |
+
inference: false
|
16 |
+
license_link: https://mistral.ai/licenses/MRL-0.1.md
|
17 |
+
extra_gated_prompt: '# Mistral AI Research License
|
18 |
+
|
19 |
+
If You want to use a Mistral Model, a Derivative or an Output for any purpose that
|
20 |
+
is not expressly authorized under this Agreement, You must request a license from
|
21 |
+
Mistral AI, which Mistral AI may grant to You in Mistral AI''s sole discretion.
|
22 |
+
To discuss such a license, please contact Mistral AI via the website contact form:
|
23 |
+
https://mistral.ai/contact/
|
24 |
+
|
25 |
+
## 1. Scope and acceptance
|
26 |
+
|
27 |
+
**1.1. Scope of the Agreement.** This Agreement applies to any use, modification,
|
28 |
+
or Distribution of any Mistral Model by You, regardless of the source You obtained
|
29 |
+
a copy of such Mistral Model.
|
30 |
+
|
31 |
+
**1.2. Acceptance.** By accessing, using, modifying, Distributing a Mistral Model,
|
32 |
+
or by creating, using or distributing a Derivative of the Mistral Model, You agree
|
33 |
+
to be bound by this Agreement.
|
34 |
+
|
35 |
+
**1.3. Acceptance on behalf of a third-party.** If You accept this Agreement on
|
36 |
+
behalf of Your employer or another person or entity, You warrant and represent that
|
37 |
+
You have the authority to act and accept this Agreement on their behalf. In such
|
38 |
+
a case, the word "You" in this Agreement will refer to Your employer or such other
|
39 |
+
person or entity.
|
40 |
+
|
41 |
+
## 2. License
|
42 |
+
|
43 |
+
**2.1. Grant of rights**. Subject to Section 3 below, Mistral AI hereby grants
|
44 |
+
You a non-exclusive, royalty-free, worldwide, non-sublicensable, non-transferable,
|
45 |
+
limited license to use, copy, modify, and Distribute under the conditions provided
|
46 |
+
in Section 2.2 below, the Mistral Model and any Derivatives made by or for Mistral
|
47 |
+
AI and to create Derivatives of the Mistral Model.
|
48 |
+
|
49 |
+
**2.2. Distribution of Mistral Model and Derivatives made by or for Mistral AI.**
|
50 |
+
Subject to Section 3 below, You may Distribute copies of the Mistral Model and/or
|
51 |
+
Derivatives made by or for Mistral AI, under the following conditions: You must
|
52 |
+
make available a copy of this Agreement to third-party recipients of the Mistral
|
53 |
+
Models and/or Derivatives made by or for Mistral AI you Distribute, it being specified
|
54 |
+
that any rights to use the Mistral Models and/or Derivatives made by or for Mistral
|
55 |
+
AI shall be directly granted by Mistral AI to said third-party recipients pursuant
|
56 |
+
to the Mistral AI Research License agreement executed between these parties; You
|
57 |
+
must retain in all copies of the Mistral Models the following attribution notice
|
58 |
+
within a "Notice" text file distributed as part of such copies: "Licensed by Mistral
|
59 |
+
AI under the Mistral AI Research License".
|
60 |
+
|
61 |
+
**2.3. Distribution of Derivatives made by or for You.** Subject to Section 3 below,
|
62 |
+
You may Distribute any Derivatives made by or for You under additional or different
|
63 |
+
terms and conditions, provided that: In any event, the use and modification of Mistral
|
64 |
+
Model and/or Derivatives made by or for Mistral AI shall remain governed by the
|
65 |
+
terms and conditions of this Agreement; You include in any such Derivatives made
|
66 |
+
by or for You prominent notices stating that You modified the concerned Mistral
|
67 |
+
Model; and Any terms and conditions You impose on any third-party recipients relating
|
68 |
+
to Derivatives made by or for You shall neither limit such third-party recipients''
|
69 |
+
use of the Mistral Model or any Derivatives made by or for Mistral AI in accordance
|
70 |
+
with the Mistral AI Research License nor conflict with any of its terms and conditions.
|
71 |
+
|
72 |
+
## 3. Limitations
|
73 |
+
|
74 |
+
**3.1. Misrepresentation.** You must not misrepresent or imply, through any means,
|
75 |
+
that the Derivatives made by or for You and/or any modified version of the Mistral
|
76 |
+
Model You Distribute under your name and responsibility is an official product of
|
77 |
+
Mistral AI or has been endorsed, approved or validated by Mistral AI, unless You
|
78 |
+
are authorized by Us to do so in writing.
|
79 |
+
|
80 |
+
**3.2. Usage Limitation.** You shall only use the Mistral Models, Derivatives (whether
|
81 |
+
or not created by Mistral AI) and Outputs for Research Purposes.
|
82 |
+
|
83 |
+
## 4. Intellectual Property
|
84 |
+
|
85 |
+
**4.1. Trademarks.** No trademark licenses are granted under this Agreement, and
|
86 |
+
in connection with the Mistral Models, You may not use any name or mark owned by
|
87 |
+
or associated with Mistral AI or any of its affiliates, except (i) as required for
|
88 |
+
reasonable and customary use in describing and Distributing the Mistral Models and
|
89 |
+
Derivatives made by or for Mistral AI and (ii) for attribution purposes as required
|
90 |
+
by this Agreement.
|
91 |
+
|
92 |
+
**4.2. Outputs.** We claim no ownership rights in and to the Outputs. You are solely
|
93 |
+
responsible for the Outputs You generate and their subsequent uses in accordance
|
94 |
+
with this Agreement. Any Outputs shall be subject to the restrictions set out in
|
95 |
+
Section 3 of this Agreement.
|
96 |
+
|
97 |
+
**4.3. Derivatives.** By entering into this Agreement, You accept that any Derivatives
|
98 |
+
that You may create or that may be created for You shall be subject to the restrictions
|
99 |
+
set out in Section 3 of this Agreement.
|
100 |
+
|
101 |
+
## 5. Liability
|
102 |
+
|
103 |
+
**5.1. Limitation of liability.** In no event, unless required by applicable law
|
104 |
+
(such as deliberate and grossly negligent acts) or agreed to in writing, shall Mistral
|
105 |
+
AI be liable to You for damages, including any direct, indirect, special, incidental,
|
106 |
+
or consequential damages of any character arising as a result of this Agreement
|
107 |
+
or out of the use or inability to use the Mistral Models and Derivatives (including
|
108 |
+
but not limited to damages for loss of data, loss of goodwill, loss of expected
|
109 |
+
profit or savings, work stoppage, computer failure or malfunction, or any damage
|
110 |
+
caused by malware or security breaches), even if Mistral AI has been advised of
|
111 |
+
the possibility of such damages.
|
112 |
+
|
113 |
+
**5.2. Indemnification.** You agree to indemnify and hold harmless Mistral AI from
|
114 |
+
and against any claims, damages, or losses arising out of or related to Your use
|
115 |
+
or Distribution of the Mistral Models and Derivatives.
|
116 |
+
|
117 |
+
## 6. Warranty
|
118 |
+
|
119 |
+
**6.1. Disclaimer.** Unless required by applicable law or prior agreed to by Mistral
|
120 |
+
AI in writing, Mistral AI provides the Mistral Models and Derivatives on an "AS
|
121 |
+
IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied,
|
122 |
+
including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT,
|
123 |
+
MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. Mistral AI does not represent
|
124 |
+
nor warrant that the Mistral Models and Derivatives will be error-free, meet Your
|
125 |
+
or any third party''s requirements, be secure or will allow You or any third party
|
126 |
+
to achieve any kind of result or generate any kind of content. You are solely responsible
|
127 |
+
for determining the appropriateness of using or Distributing the Mistral Models
|
128 |
+
and Derivatives and assume any risks associated with Your exercise of rights under
|
129 |
+
this Agreement.
|
130 |
+
|
131 |
+
## 7. Termination
|
132 |
+
|
133 |
+
**7.1. Term.** This Agreement is effective as of the date of your acceptance of
|
134 |
+
this Agreement or access to the concerned Mistral Models or Derivatives and will
|
135 |
+
continue until terminated in accordance with the following terms.
|
136 |
+
|
137 |
+
**7.2. Termination.** Mistral AI may terminate this Agreement at any time if You
|
138 |
+
are in breach of this Agreement. Upon termination of this Agreement, You must cease
|
139 |
+
to use all Mistral Models and Derivatives and shall permanently delete any copy
|
140 |
+
thereof. The following provisions, in their relevant parts, will survive any termination
|
141 |
+
or expiration of this Agreement, each for the duration necessary to achieve its
|
142 |
+
own intended purpose (e.g. the liability provision will survive until the end of
|
143 |
+
the applicable limitation period):Sections 5 (Liability), 6(Warranty), 7 (Termination)
|
144 |
+
and 8 (General Provisions).
|
145 |
+
|
146 |
+
**7.3. Litigation.** If You initiate any legal action or proceedings against Us
|
147 |
+
or any other entity (including a cross-claim or counterclaim in a lawsuit), alleging
|
148 |
+
that the Model or a Derivative, or any part thereof, infringe upon intellectual
|
149 |
+
property or other rights owned or licensable by You, then any licenses granted to
|
150 |
+
You under this Agreement will immediately terminate as of the date such legal action
|
151 |
+
or claim is filed or initiated.
|
152 |
+
|
153 |
+
## 8. General provisions
|
154 |
+
|
155 |
+
**8.1. Governing laws.** This Agreement will be governed by the laws of France,
|
156 |
+
without regard to choice of law principles, and the UN Convention on Contracts for
|
157 |
+
the International Sale of Goods does not apply to this Agreement.
|
158 |
+
|
159 |
+
**8.2. Competent jurisdiction.** The courts of Paris shall have exclusive jurisdiction
|
160 |
+
of any dispute arising out of this Agreement.
|
161 |
+
|
162 |
+
**8.3. Severability.** If any provision of this Agreement is held to be invalid,
|
163 |
+
illegal or unenforceable, the remaining provisions shall be unaffected thereby and
|
164 |
+
remain valid as if such provision had not been set forth herein.
|
165 |
+
|
166 |
+
## 9. Definitions
|
167 |
+
|
168 |
+
"Agreement": means this Mistral AI Research License agreement governing the access,
|
169 |
+
use, and Distribution of the Mistral Models, Derivatives and Outputs.
|
170 |
+
|
171 |
+
"Derivative": means any (i) modified version of the Mistral Model (including but
|
172 |
+
not limited to any customized or fine-tuned version thereof), (ii) work based on
|
173 |
+
the Mistral Model, or (iii) any other derivative work thereof.
|
174 |
+
|
175 |
+
"Distribution", "Distributing", "Distribute" or "Distributed": means supplying,
|
176 |
+
providing or making available, by any means, a copy of the Mistral Models and/or
|
177 |
+
the Derivatives as the case may be, subject to Section 3 of this Agreement.
|
178 |
+
|
179 |
+
"Mistral AI", "We" or "Us": means Mistral AI, a French société par actions simplifiée
|
180 |
+
registered in the Paris commercial registry under the number 952 418 325, and having
|
181 |
+
its registered seat at 15, rue des Halles, 75001 Paris.
|
182 |
+
|
183 |
+
"Mistral Model": means the foundational large language model(s), and its elements
|
184 |
+
which include algorithms, software, instructed checkpoints, parameters, source code
|
185 |
+
(inference code, evaluation code and, if applicable, fine-tuning code) and any other
|
186 |
+
elements associated thereto made available by Mistral AI under this Agreement, including,
|
187 |
+
if any, the technical documentation, manuals and instructions for the use and operation
|
188 |
+
thereof.
|
189 |
+
|
190 |
+
"Research Purposes": means any use of a Mistral Model, Derivative, or Output that
|
191 |
+
is solely for (a) personal, scientific or academic research, and (b) for non-profit
|
192 |
+
and non-commercial purposes, and not directly or indirectly connected to any commercial
|
193 |
+
activities or business operations. For illustration purposes, Research Purposes
|
194 |
+
does not include (1) any usage of the Mistral Model, Derivative or Output by individuals
|
195 |
+
or contractors employed in or engaged by companies in the context of (a) their daily
|
196 |
+
tasks, or (b) any activity (including but not limited to any testing or proof-of-concept)
|
197 |
+
that is intended to generate revenue, nor (2) any Distribution by a commercial entity
|
198 |
+
of the Mistral Model, Derivative or Output whether in return for payment or free
|
199 |
+
of charge, in any medium or form, including but not limited to through a hosted
|
200 |
+
or managed service (e.g. SaaS, cloud instances, etc.), or behind a software layer.
|
201 |
+
|
202 |
+
"Outputs": means any content generated by the operation of the Mistral Models or
|
203 |
+
the Derivatives from a prompt (i.e., text instructions) provided by users. For
|
204 |
+
the avoidance of doubt, Outputs do not include any components of a Mistral Models,
|
205 |
+
such as any fine-tuned versions of the Mistral Models, the weights, or parameters.
|
206 |
+
|
207 |
+
"You": means the individual or entity entering into this Agreement with Mistral
|
208 |
+
AI.
|
209 |
+
|
210 |
+
|
211 |
+
*Mistral AI processes your personal data below to provide the model and enforce
|
212 |
+
its license. If you are affiliated with a commercial entity, we may also send you
|
213 |
+
communications about our models. For more information on your rights and data handling,
|
214 |
+
please see our <a href="https://mistral.ai/terms/">privacy policy</a>.*'
|
215 |
+
extra_gated_fields:
|
216 |
+
First Name: text
|
217 |
+
Last Name: text
|
218 |
+
Country: country
|
219 |
+
Affiliation: text
|
220 |
+
Job title: text
|
221 |
+
I understand that I can only use the model, any derivative versions and their outputs for non-commercial research purposes: checkbox
|
222 |
+
? I understand that if I am a commercial entity, I am not permitted to use or distribute
|
223 |
+
the model internally or externally, or expose it in my own offerings without a
|
224 |
+
commercial license
|
225 |
+
: checkbox
|
226 |
+
? I understand that if I upload the model, or any derivative version, on any platform,
|
227 |
+
I must include the Mistral Research License
|
228 |
+
: checkbox
|
229 |
+
? I understand that for commercial use of the model, I can contact Mistral or use
|
230 |
+
the Mistral AI API on la Plateforme or any of our cloud provider partners
|
231 |
+
: checkbox
|
232 |
+
? By clicking Submit below I accept the terms of the license and acknowledge that
|
233 |
+
the information I provide will be collected stored processed and shared in accordance
|
234 |
+
with the Mistral Privacy Policy
|
235 |
+
: checkbox
|
236 |
+
geo: ip_location
|
237 |
+
extra_gated_description: Mistral AI processes your personal data below to provide
|
238 |
+
the model and enforce its license. If you are affiliated with a commercial entity,
|
239 |
+
we may also send you communications about our models. For more information on your
|
240 |
+
rights and data handling, please see our <a href="https://mistral.ai/terms/">privacy
|
241 |
+
policy</a>.
|
242 |
+
extra_gated_button_content: Submit
|
243 |
+
library_name: vllm
|
244 |
+
base_model: mistralai/Ministral-8B-Instruct-2410
|
245 |
+
tags:
|
246 |
+
- llama-cpp
|
247 |
+
- gguf
|
248 |
+
---
|
249 |
+
|
250 |
+
# Supa-AI/Ministral-8B-Instruct-2410-gguf
|
251 |
+
This model was converted to GGUF format from [`mistralai/Ministral-8B-Instruct-2410`](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410) using llama.cpp.
|
252 |
+
Refer to the [original model card](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410) for more details on the model.
|
253 |
+
|
254 |
+
## Available Versions
|
255 |
+
- `Ministral-8B-Instruct-2410.q8_0.gguf` (q8_0)
|
256 |
+
|
257 |
+
## Use with llama.cpp
|
258 |
+
Replace `FILENAME` with one of the above filenames.
|
259 |
+
|
260 |
+
### CLI:
|
261 |
+
```bash
|
262 |
+
llama-cli --hf-repo Supa-AI/Ministral-8B-Instruct-2410-gguf --hf-file FILENAME -p "Your prompt here"
|
263 |
+
```
|
264 |
+
|
265 |
+
### Server:
|
266 |
+
```bash
|
267 |
+
llama-server --hf-repo Supa-AI/Ministral-8B-Instruct-2410-gguf --hf-file FILENAME -c 2048
|
268 |
+
```
|
269 |
+
|
270 |
+
## Model Details
|
271 |
+
- **Original Model:** [mistralai/Ministral-8B-Instruct-2410](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410)
|
272 |
+
- **Format:** GGUF
|