Update README.md
Browse files
README.md
CHANGED
@@ -45,18 +45,18 @@ model = PeftModel.from_pretrained(model, "damerajee/Tinyllama-sft-small")l")
|
|
45 |
inputs = tokenizer(
|
46 |
[
|
47 |
alpaca_prompt.format(
|
48 |
-
"
|
49 |
"", # input
|
50 |
"", # output
|
51 |
)
|
52 |
-
]*1, return_tensors = "pt")
|
53 |
|
54 |
-
outputs = model.generate(**inputs, max_new_tokens =
|
55 |
tokenizer.batch_decode(outputs)
|
56 |
```
|
57 |
|
58 |
# Model Information
|
59 |
-
The base model [unsloth/tinyllama-bnb-4bit](https://huggingface.co/unsloth/tinyllama-bnb-4bit)was Instruct finetuned using [Unsloth](https://github.com/unslothai/unsloth)
|
60 |
|
61 |
# Training Details
|
62 |
|
|
|
45 |
inputs = tokenizer(
|
46 |
[
|
47 |
alpaca_prompt.format(
|
48 |
+
"choose ronaldo or messi?", # instruction
|
49 |
"", # input
|
50 |
"", # output
|
51 |
)
|
52 |
+
]*1, return_tensors = "pt")
|
53 |
|
54 |
+
outputs = model.generate(**inputs, max_new_tokens = 128, use_cache = True)
|
55 |
tokenizer.batch_decode(outputs)
|
56 |
```
|
57 |
|
58 |
# Model Information
|
59 |
+
The base model [unsloth/tinyllama-bnb-4bit](https://huggingface.co/unsloth/tinyllama-bnb-4bit) was Instruct finetuned using [Unsloth](https://github.com/unslothai/unsloth)
|
60 |
|
61 |
# Training Details
|
62 |
|