damerajee commited on
Commit
3c6a3e8
1 Parent(s): fda267d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -45,18 +45,18 @@ model = PeftModel.from_pretrained(model, "damerajee/Tinyllama-sft-small")l")
45
  inputs = tokenizer(
46
  [
47
  alpaca_prompt.format(
48
- "i want to learn machine learning help me",
49
  "", # input
50
  "", # output
51
  )
52
- ]*1, return_tensors = "pt").to("cuda")
53
 
54
- outputs = model.generate(**inputs, max_new_tokens = 312, use_cache = True)
55
  tokenizer.batch_decode(outputs)
56
  ```
57
 
58
  # Model Information
59
- The base model [unsloth/tinyllama-bnb-4bit](https://huggingface.co/unsloth/tinyllama-bnb-4bit)was Instruct finetuned using [Unsloth](https://github.com/unslothai/unsloth)
60
 
61
  # Training Details
62
 
 
45
  inputs = tokenizer(
46
  [
47
  alpaca_prompt.format(
48
+ "choose ronaldo or messi?", # instruction
49
  "", # input
50
  "", # output
51
  )
52
+ ]*1, return_tensors = "pt")
53
 
54
+ outputs = model.generate(**inputs, max_new_tokens = 128, use_cache = True)
55
  tokenizer.batch_decode(outputs)
56
  ```
57
 
58
  # Model Information
59
+ The base model [unsloth/tinyllama-bnb-4bit](https://huggingface.co/unsloth/tinyllama-bnb-4bit) was Instruct finetuned using [Unsloth](https://github.com/unslothai/unsloth)
60
 
61
  # Training Details
62