prince-canuma commited on
Commit
59210ff
1 Parent(s): 5686201

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gemma
3
+ library_name: transformers
4
+ tags:
5
+ - mlx
6
+ extra_gated_heading: Access Gemma on Hugging Face
7
+ extra_gated_prompt: To access CodeGemma on Hugging Face, you’re required to review
8
+ and agree to Google’s usage license. To do this, please ensure you’re logged-in
9
+ to Hugging Face and click below. Requests are processed immediately.
10
+ extra_gated_button_content: Acknowledge license
11
+ license_link: https://ai.google.dev/gemma/terms
12
+ ---
13
+
14
+ # mlx-community/codegemma-2b-4bit
15
+ This model was converted to MLX format from [`google/codegemma-7b-it`]() using mlx-lm version **0.8.0**.
16
+
17
+ Model added by [Prince Canuma](https://twitter.com/Prince_Canuma).
18
+
19
+ Refer to the [original model card](https://huggingface.co/google/codegemma-7b-it) for more details on the model.
20
+ ## Use with mlx
21
+
22
+ ```bash
23
+ pip install mlx-lm
24
+ ```
25
+
26
+ ```python
27
+ from mlx_lm import load, generate
28
+
29
+ model, tokenizer = load("mlx-community/codegemma-2b-4bit")
30
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
31
+ ```