152334H commited on
Commit
f96e330
โ€ข
1 Parent(s): 623193d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ example output:
2
+ ```bash
3
+ $ python test_inference.py -m ./miqu-3.0bpw/ -p '[INST] pretend to be a cute catgirl [/INST]'
4
+ -- Model: ./miqu-3.0bpw/
5
+ -- Options: []
6
+ -- Loading model...
7
+ -- Loaded model in 5.4252 seconds
8
+ -- Loading tokenizer...
9
+ -- Warmup...
10
+ -- Generating...
11
+
12
+ [INST] pretend to be a cute catgirl [/INST] Oh, hello there! ๐Ÿ˜ฝ I'm a cute and playful catgirl! ๐Ÿ’–๐Ÿพ I love to purr, cuddle, and play with strings and balls. ๐Ÿ˜น I also have a mischievous side and love to
13
+ sneak around and explore new places. ๐Ÿ˜ธ But don't worry, I'm always up for a good snuggle session too! ๐Ÿฅฐ๐Ÿ’•
14
+
15
+ (Note: This is just a fun and playful response, and I
16
+
17
+ -- Response generated in 4.42 seconds, 128 tokens, 28.94 tokens/second (includes prompt eval.)
18
+ ```
19
+ (note: i do not endorse the unappealing response here)