New, adapter based instructions

README.md

@@ -222,7 +222,7 @@ datasets:
 
 # obvr/Llama-3-Lluca-8B
 
-> ! Warning: The fusing of the model seems to have not applied properly. Please use the adapters directly.
+> ! Warning: The fusing of the model seems to have not applied properly. Please use the adapters directly. The example has been updated to show this process.
 
 [LLuca](https://huggingface.co/obvr/Llama-3-Lluca-8B) is a fine-tuned LLaMa 3 model based on [NousResearch/Meta-Llama-3-8B](https://huggingface.co/NousResearch/Meta-Llama-3-8B). It is targeting financial sentiment analysis using FinGPT's dataset.
 Training was done on an M1 Ultra using MLX **0.13.0**.
@@ -231,12 +231,21 @@ Training was done on an M1 Ultra using MLX **0.13.0**.
 ## Use with mlx
 
 ```bash
-pip install mlx-lm
+pip install mlx-lm huggingface_hub
 ```
 
 ```python
+
 from mlx_lm import load, generate
+from huggingface_hub import snapshot_download
+
+tokenizer_config = {"trust_remote_code": True, "eos_token": "<|eot_id|>"}
+adapter_path = snapshot_download(repo_id="obvr/Llama-3-Lluca-8B", allow_patterns=["adapters/adapter_config.json", "adapters/adapters.safetensors"]) + "/adapters"
+llm_model, tokenizer = load("NousResearch/Meta-Llama-3-8B-Instruct", adapter_path=adapter_path, tokenizer_config=tokenizer_config)
+
+prompt = "What is the sentiment of this news? Please choose an answer from {strong negative/moderately negative/mildly negative/neutral/mildly positive/moderately positive/strong positive}. Reports were released yesterday evening saying that Amazon.com, Inc. (NASDAQ:AMZN) is planning on laying off roughly 10,000 of its corporate and tech employees, starting this week."
+messages = [{"role": "user", "content": prompt}]
+prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
 
-model, tokenizer = load("obvr/Llama-3-Lluca-8B")
-response = generate(model,tokenizer, prompt="What is the sentiment of this news? Please choose an answer from {strong negative/moderately negative/mildly negative/neutral/mildly positive/moderately positive/strong positive}. Reports were released yesterday evening saying that Amazon.com, Inc. (NASDAQ:AMZN) is planning on laying off roughly 10,000 of its corporate and tech employees, starting this week.", verbose=True)
+response = generate(llm_model, tokenizer, prompt=prompt, verbose=True)
 ```