README.md

---
license: other
tags:
- mlx
extra_gated_heading: You need to share contact information with Databricks to access
  this model
extra_gated_prompt: '

  ### DBRX Terms of Use

  Use of DBRX is governed by the [Databricks Open Model License](https://www.databricks.com/legal/open-model-license)
  and the [Databricks Open Model Acceptable Use Policy](https://www.databricks.com/legal/acceptable-use-policy-open-model).'
extra_gated_fields:
  First Name: text
  Last Name: text
  Organization: text
  ? By clicking 'Submit' below, I accept the terms of the license and acknowledge
    that the information I provide will be collected, stored, processed, and shared
    in accordance with Databricks' Privacy Notice and I understand I can update my
    preferences at any time
  : checkbox
extra_gated_description: The information you provide will be collected, stored, processed,
  and shared in accordance with Databricks [Privacy Notice](https://www.databricks.com/legal/privacynotice).
extra_gated_button_content: Submit
inference: false
license_name: databricks-open-model-license
license_link: https://www.databricks.com/legal/open-model-license
---

# mlx-community/dbrx-instruct-4bit
This model was converted to MLX format from [`databricks/dbrx-instruct`]() using mlx-lm version **0.4.0**.
Refer to the [original model card](https://huggingface.co/databricks/dbrx-instruct) for more details on the model.
## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/dbrx-instruct-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```