File size: 5,997 Bytes
ce54355
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
---
base_model: CrabfishAI/InstructWise-462M
datasets:
- timdettmers/openassistant-guanaco
inference: false
language:
- en
license: llama2
model_creator: CrabfishAI
model_name: InstructWise-462M
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- autotrain
- text-generation
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
widget:
- text: '### Instruction:

    Find me a list of some nice places to visit around the world.


    ### Response:'
- text: '### Instruction:

    Tell me a story about some magical place.


    ### Response:'
- text: '### Instruction:

    Write a python code to print numbers from 1 to 100 in sequence.


    ### Response:'
- text: '### Instruction:

    What is biology?


    ### Response:'
- text: '### Instruction:

    I love taking photos of nature. Can you come up with a 3-day itinerary visiting
    the most photogenic places in Iceland?


    ### Response:'
---
# CrabfishAI/InstructWise-462M-GGUF

Quantized GGUF model files for [InstructWise-462M](https://huggingface.co/CrabfishAI/InstructWise-462M) from [CrabfishAI](https://huggingface.co/CrabfishAI)


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [instructwise-462m.fp16.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.fp16.gguf) | fp16 | 925.45 MB  |
| [instructwise-462m.q2_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q2_k.gguf) | q2_k | 212.56 MB  |
| [instructwise-462m.q3_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q3_k_m.gguf) | q3_k_m | 238.87 MB  |
| [instructwise-462m.q4_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q4_k_m.gguf) | q4_k_m | 288.52 MB  |
| [instructwise-462m.q5_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q5_k_m.gguf) | q5_k_m | 333.29 MB  |
| [instructwise-462m.q6_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q6_k.gguf) | q6_k | 380.87 MB  |
| [instructwise-462m.q8_0.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q8_0.gguf) | q8_0 | 492.67 MB  |



## Original Model Card:
# InstructWise 470M - A virtual assistant.
Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!
Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency.
# Credits
- **Base Model:** ahxt/llama2_xs_460M_experimental
- **Dataset used:** timdettmers/openassistant-guanaco
 - **License:** llama2

## Features
- **Maintaining performance while being memory efficient:** Ram usage- 7.1GB Vram usage- 0.6GB (approximately)
- **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information. 
- **Coding:** Model can perform coding as well.
- **Assisting capabilities:** can assist with wide rang of taskes.

## Uses

InstructWise finds application in various domains, including:

- **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
- **Chatbot Development:** Power conversational agents with human-like responses.
- **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
- **Personal Assistant Applications:** Assist users in drafting emails and messages.
and many more.

## Direct Use Cases

InstructWise can be directly employed for:

1. **Educational Support:**
   - Assist users in learning new topics with detailed explanations and step-by-step instructions.

2. **Content Creation:**
   - Generate creative content based on prompts, aiding content creators in the writing process.

3. **Code Assistance:**
   - Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.

4. **Interactive Conversations:**
   - Enhance chatbots or virtual assistants with informative and helpful responses for users.

5. **Q&A Platforms:**
   - Power question and answer platforms, offering detailed and insightful answers on various topics.

6. **Technical Writing Support:**
   - Assist writers and technical communicators with suggestions for clarity and informativeness.

7. **Idea Expansion:**
   - Facilitate the expansion and development of ideas by providing detailed insights and suggestions.


## Limitation

1. **Content Quality**: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.

2. **Bias and Sensitivity**: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.

3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.



## Disclaimer

- **Use with Caution**: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.

- **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.

- **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.

## Recommended Prompt Format to use:
```
### Instruction:
<instruction>

### Response:
```