Text Generation
Transformers
GGUF
Inference Endpoints
milkowski's picture
Quantized models
20eec44 verified
FROM model.gguf
TEMPLATE """{{ .System }}
@@ Instruction
{{ .Prompt }}
@@ Response
"""
SYSTEM """You are an exceptionally intelligent coding assistant that consistently delivers accurate and reliable responses to user instructions."""
PARAMETER num_ctx 16384