FinysterLin/k8s-llama-expert

---

base_model: unsloth/Meta-Llama-3.1-8B-bnb-4bit library_name: transformers tags: - unsloth - llama-3 - kubernetes - devops - gguf - text-generation license: apache-2.0 language: - en

Kubernetes Expert Llama-3.1-8B (GGUF)

This model is a fine-tuned version of Llama-3.1-8B, specifically trained to be a Kubernetes Expert. It was trained using Unsloth and LoRA on a high-quality StackOverflow Kubernetes dataset.

🚀 Model Features

• Format: GGUF (Quantized to Q4_K_M)
• Use Case: Answering technical K8s questions, debugging pods (CrashLoopBackOff), and generating YAML configurations.
• Performance: 2x faster inference speed compared to the baseline model with significantly better domain knowledge.

📦 How to Use with Ollama

1. Download the Model Download k8s-expert-rescue.Q4_K_M.gguf from the Files tab.

2. Create a Modelfile Create a file named Modelfile with the following content:

   FROM ./k8s-expert-rescue.Q4_K_M.gguf
   
   TEMPLATE """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
   
   ### Instruction:
   You are a Kubernetes expert. Provide a technical solution to the following problem.
   
   ### Input:
   {{ .Prompt }}
   
   ### Response:
   """
   
   PARAMETER temperature 0.6
   PARAMETER num_ctx 4096
   PARAMETER stop "<|end_of_text|>"
   PARAMETER stop "### Instruction:"
   PARAMETER stop "### Input:"