The babyllama-v0.6-gguf llm is quantized in 4bit using llama.cpp The original model: kevin009/babyllama-v0.6 This repo contains an "apk" which is chatNONET. This app is an offline chatbot. You can ask any questions to it. We use babyllama as a language model to developed this offline chatbot app. ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/665f017c55bfce6b3144bc6c/fyYKDX1hzVc9csLW-Eb8e.jpeg)