Paper
MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability [ https://arxiv.org/abs/2405.14488 ]
Github: [ https://github.com/DYR1/MoGU/ ]
Introduction
We open-source the safer falcon-7b-instruct [ https://huggingface.co/tiiuae/falcon-7b-instruct ], trained with our proposed MoGU framework. Technical details of MoGU can be found in the paper ''MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability''. We release the parameters and the inference code. The current inference code is still in a simple version and we will further improve it. In the future, we plan to open-source the training data and the training code.
You can use our open-sourced LLM by following the steps below.
Configuration Environment
pip install -r requirement.txt
Inference Stage
python inference.py
Some test examples are provided in inference.py.