--- base_model: CrabfishAI/InstructWise-462M datasets: - timdettmers/openassistant-guanaco inference: false language: - en license: llama2 model_creator: CrabfishAI model_name: InstructWise-462M pipeline_tag: text-generation quantized_by: afrideva tags: - autotrain - text-generation - gguf - ggml - quantized - q2_k - q3_k_m - q4_k_m - q5_k_m - q6_k - q8_0 widget: - text: '### Instruction: Find me a list of some nice places to visit around the world. ### Response:' - text: '### Instruction: Tell me a story about some magical place. ### Response:' - text: '### Instruction: Write a python code to print numbers from 1 to 100 in sequence. ### Response:' - text: '### Instruction: What is biology? ### Response:' - text: '### Instruction: I love taking photos of nature. Can you come up with a 3-day itinerary visiting the most photogenic places in Iceland? ### Response:' --- # CrabfishAI/InstructWise-462M-GGUF Quantized GGUF model files for [InstructWise-462M](https://huggingface.co/CrabfishAI/InstructWise-462M) from [CrabfishAI](https://huggingface.co/CrabfishAI) | Name | Quant method | Size | | ---- | ---- | ---- | | [instructwise-462m.fp16.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.fp16.gguf) | fp16 | 925.45 MB | | [instructwise-462m.q2_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q2_k.gguf) | q2_k | 212.56 MB | | [instructwise-462m.q3_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q3_k_m.gguf) | q3_k_m | 238.87 MB | | [instructwise-462m.q4_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q4_k_m.gguf) | q4_k_m | 288.52 MB | | [instructwise-462m.q5_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q5_k_m.gguf) | q5_k_m | 333.29 MB | | [instructwise-462m.q6_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q6_k.gguf) | q6_k | 380.87 MB | | [instructwise-462m.q8_0.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q8_0.gguf) | q8_0 | 492.67 MB | ## Original Model Card: # InstructWise 470M - A virtual assistant. Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you! Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency. # Credits - **Base Model:** ahxt/llama2_xs_460M_experimental - **Dataset used:** timdettmers/openassistant-guanaco - **License:** llama2 ## Features - **Maintaining performance while being memory efficient:** Ram usage- 7.1GB Vram usage- 0.6GB (approximately) - **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information. - **Coding:** Model can perform coding as well. - **Assisting capabilities:** can assist with wide rang of taskes. ## Uses InstructWise finds application in various domains, including: - **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays. - **Chatbot Development:** Power conversational agents with human-like responses. - **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development. - **Personal Assistant Applications:** Assist users in drafting emails and messages. and many more. ## Direct Use Cases InstructWise can be directly employed for: 1. **Educational Support:** - Assist users in learning new topics with detailed explanations and step-by-step instructions. 2. **Content Creation:** - Generate creative content based on prompts, aiding content creators in the writing process. 3. **Code Assistance:** - Provide guidance on coding queries, improve code documentation, and generate code snippets for developers. 4. **Interactive Conversations:** - Enhance chatbots or virtual assistants with informative and helpful responses for users. 5. **Q&A Platforms:** - Power question and answer platforms, offering detailed and insightful answers on various topics. 6. **Technical Writing Support:** - Assist writers and technical communicators with suggestions for clarity and informativeness. 7. **Idea Expansion:** - Facilitate the expansion and development of ideas by providing detailed insights and suggestions. ## Limitation 1. **Content Quality**: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect. 2. **Bias and Sensitivity**: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use. 3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential. ## Disclaimer - **Use with Caution**: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication. - **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes. - **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results. ## Recommended Prompt Format to use: ``` ### Instruction: ### Response: ```