MLX
English
llama
File size: 898 Bytes
01a7088
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
language:
- en
license: apache-2.0
tags:
- mlx
datasets:
- cerebras/SlimPajama-627B
- bigcode/starcoderdata
- HuggingFaceH4/ultrachat_200k
- HuggingFaceH4/ultrafeedback_binarized
widget:
- text: '<|system|>

    You are a chatbot who can help code!</s>

    <|user|>

    Write me a function to calculate the first 10 digits of the fibonacci sequence
    in Python and print it out to the CLI.</s>

    <|assistant|>

    '
---

# TinyLlama-1.1B-Chat-v1.0-4bit
This model was converted to MLX format from [`TinyLlama/TinyLlama-1.1B-Chat-v1.0`]().
Refer to the [original model card](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) for more details on the model.
## Use with mlx
```bash
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/TinyLlama-1.1B-Chat-v1.0-4bit --prompt "My name is"
```