Hugging Face's logo

GPT4All-Community
/
Meta-Llama-3.1-8B-Instruct-128k-GGUF

Text Generation
GGUF
text-generation-inference
Inference Endpoints
conversational
Model card Files Community
2
Meta-Llama-3.1-8B-Instruct-128k-GGUF / README.md
ThiloteE's picture
ThiloteE
Update README.md
350b6d7 verified
preview code
|
raw
history blame contribute delete
1.04 kB
metadata
license: llama3.1
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
pipeline_tag: text-generation
tags:
  - text-generation-inference

This is a model that is assumed to perform well, but may require more testing and user feedback. Be aware, only models featured within the GUI of GPT4All, are curated and officially supported by Nomic. Use at your own risk.

About

Model converted and quantized by: 3Simplex.
GPT4All v3.1.1 required.

image/png

Prompt Template 

<|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|>

<|start_header_id|>user<|end_header_id|>

{user_input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{assistant_response}

128k Context Length

"llama.context_length": 131072