afrideva commited on
Commit
ce54355
1 Parent(s): c0c8bf9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +150 -0
README.md ADDED
@@ -0,0 +1,150 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: CrabfishAI/InstructWise-462M
3
+ datasets:
4
+ - timdettmers/openassistant-guanaco
5
+ inference: false
6
+ language:
7
+ - en
8
+ license: llama2
9
+ model_creator: CrabfishAI
10
+ model_name: InstructWise-462M
11
+ pipeline_tag: text-generation
12
+ quantized_by: afrideva
13
+ tags:
14
+ - autotrain
15
+ - text-generation
16
+ - gguf
17
+ - ggml
18
+ - quantized
19
+ - q2_k
20
+ - q3_k_m
21
+ - q4_k_m
22
+ - q5_k_m
23
+ - q6_k
24
+ - q8_0
25
+ widget:
26
+ - text: '### Instruction:
27
+
28
+ Find me a list of some nice places to visit around the world.
29
+
30
+
31
+ ### Response:'
32
+ - text: '### Instruction:
33
+
34
+ Tell me a story about some magical place.
35
+
36
+
37
+ ### Response:'
38
+ - text: '### Instruction:
39
+
40
+ Write a python code to print numbers from 1 to 100 in sequence.
41
+
42
+
43
+ ### Response:'
44
+ - text: '### Instruction:
45
+
46
+ What is biology?
47
+
48
+
49
+ ### Response:'
50
+ - text: '### Instruction:
51
+
52
+ I love taking photos of nature. Can you come up with a 3-day itinerary visiting
53
+ the most photogenic places in Iceland?
54
+
55
+
56
+ ### Response:'
57
+ ---
58
+ # CrabfishAI/InstructWise-462M-GGUF
59
+
60
+ Quantized GGUF model files for [InstructWise-462M](https://huggingface.co/CrabfishAI/InstructWise-462M) from [CrabfishAI](https://huggingface.co/CrabfishAI)
61
+
62
+
63
+ | Name | Quant method | Size |
64
+ | ---- | ---- | ---- |
65
+ | [instructwise-462m.fp16.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.fp16.gguf) | fp16 | 925.45 MB |
66
+ | [instructwise-462m.q2_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q2_k.gguf) | q2_k | 212.56 MB |
67
+ | [instructwise-462m.q3_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q3_k_m.gguf) | q3_k_m | 238.87 MB |
68
+ | [instructwise-462m.q4_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q4_k_m.gguf) | q4_k_m | 288.52 MB |
69
+ | [instructwise-462m.q5_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q5_k_m.gguf) | q5_k_m | 333.29 MB |
70
+ | [instructwise-462m.q6_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q6_k.gguf) | q6_k | 380.87 MB |
71
+ | [instructwise-462m.q8_0.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q8_0.gguf) | q8_0 | 492.67 MB |
72
+
73
+
74
+
75
+ ## Original Model Card:
76
+ # InstructWise 470M - A virtual assistant.
77
+ Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!
78
+ Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency.
79
+ # Credits
80
+ - **Base Model:** ahxt/llama2_xs_460M_experimental
81
+ - **Dataset used:** timdettmers/openassistant-guanaco
82
+ - **License:** llama2
83
+
84
+ ## Features
85
+ - **Maintaining performance while being memory efficient:** Ram usage- 7.1GB Vram usage- 0.6GB (approximately)
86
+ - **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information.
87
+ - **Coding:** Model can perform coding as well.
88
+ - **Assisting capabilities:** can assist with wide rang of taskes.
89
+
90
+ ## Uses
91
+
92
+ InstructWise finds application in various domains, including:
93
+
94
+ - **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
95
+ - **Chatbot Development:** Power conversational agents with human-like responses.
96
+ - **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
97
+ - **Personal Assistant Applications:** Assist users in drafting emails and messages.
98
+ and many more.
99
+
100
+ ## Direct Use Cases
101
+
102
+ InstructWise can be directly employed for:
103
+
104
+ 1. **Educational Support:**
105
+ - Assist users in learning new topics with detailed explanations and step-by-step instructions.
106
+
107
+ 2. **Content Creation:**
108
+ - Generate creative content based on prompts, aiding content creators in the writing process.
109
+
110
+ 3. **Code Assistance:**
111
+ - Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.
112
+
113
+ 4. **Interactive Conversations:**
114
+ - Enhance chatbots or virtual assistants with informative and helpful responses for users.
115
+
116
+ 5. **Q&A Platforms:**
117
+ - Power question and answer platforms, offering detailed and insightful answers on various topics.
118
+
119
+ 6. **Technical Writing Support:**
120
+ - Assist writers and technical communicators with suggestions for clarity and informativeness.
121
+
122
+ 7. **Idea Expansion:**
123
+ - Facilitate the expansion and development of ideas by providing detailed insights and suggestions.
124
+
125
+
126
+ ## Limitation
127
+
128
+ 1. **Content Quality**: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.
129
+
130
+ 2. **Bias and Sensitivity**: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.
131
+
132
+ 3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.
133
+
134
+
135
+
136
+ ## Disclaimer
137
+
138
+ - **Use with Caution**: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.
139
+
140
+ - **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.
141
+
142
+ - **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.
143
+
144
+ ## Recommended Prompt Format to use:
145
+ ```
146
+ ### Instruction:
147
+ <instruction>
148
+
149
+ ### Response:
150
+ ```