TheCluster/ChemDFM-v1.5-8B-mlx-6bit

ChemDFM v1.5 8B 6-bit MLX

MLX version of ChemDFM v1.5 8B: An Large Language Foundation Model for Chemistry

This model was converted to MLX format from https://huggingface.co/OpenDFM/ChemDFM-v1.5-8B using mlx-lm version 0.22.1.

ChemDFM 8B is the pioneering open-sourced dialogue foundation model for Chemistry and molecule science, which is build based on LLaMa-8B. ChemDFM outperforms the open-sourced LLMs in all the typical tasks of chemistry, and even reach comparable or higher performances of GPT-4. For more details, please refer to paper.

Use with mlx

pip install -U mlx-lm

python -m mlx_lm.generate --model TheCluster/ChemDFM-v1.5-8B-mlx-6bit --max-tokens 1024 --temperature 0.5 --prompt "Can you please give detailed descriptions of the molecule below?\nCl.O=C1c2c(O)cccc2-c2nn(CCNCCO)c3ccc(NCCNCCO)c1c23"