Prompt template:
[INST] Corrects and rephrase user text grammar errors delimited by triple backticks to standard English.
### Input: Text=\`\`\`she no went to market\`\`\` [/INST]
[INST] ### Output: She didn’t go the market. [/INST]
[INST] ### Input: Text=\`\`\`${input}\`\`\` [/INST]
[INST] ### Output:
To use the fine-tuned model, you need to get a downloadable link for the model from HF and update it accordingly in the shell script. For example:
MODEL_URL="https://huggingface.co/mzbac/mistral-grammar/resolve/main/Mistral-7B-Grammar-Checker-v1.1.1.Q5_K_M.gguf"
MODEL_FILE="Mistral-7B-Grammar-Checker-v1.1.1.Q5_K_M.gguf"