README.md

metadata

license: other
tags:
  - mlx
extra_gated_heading: You need to share contact information with Databricks to access this model
extra_gated_prompt: >-

  ### DBRX Terms of Use

  Use of DBRX is governed by the [Databricks Open Model
  License](https://www.databricks.com/legal/open-model-license) and the
  [Databricks Open Model Acceptable Use
  Policy](https://www.databricks.com/legal/acceptable-use-policy-open-model).
extra_gated_fields:
  First Name: text
  Last Name: text
  Organization: text
  By clicking 'Submit' below, I accept the terms of the license and acknowledge that the information I provide will be collected, stored, processed, and shared in accordance with Databricks' Privacy Notice and I understand I can update my preferences at any time: checkbox
extra_gated_description: >-
  The information you provide will be collected, stored, processed, and shared
  in accordance with Databricks [Privacy
  Notice](https://www.databricks.com/legal/privacynotice).
extra_gated_button_content: Submit
inference: false
license_name: databricks-open-model-license
license_link: https://www.databricks.com/legal/open-model-license

mlx-community/dbrx-instruct-4bit

This model was converted to MLX format from databricks/dbrx-instruct using mlx-lm version 0.4.0. Refer to the original model card for more details on the model.

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/dbrx-instruct-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)