Hugging Face model: tensorblock/Llama-68M-Chat-v1-GGUF
Author: tensorblock
Created: 2024-11-13 19:15:22
Last modified: 2026-01-27 21:13:37
Pipeline: text-generation
Likes: 0 | Downloads: 46
Tags: gguf, text-generation, TensorBlock, GGUF, en, dataset:THUDM/webglm-qa, dataset:databricks/databricks-dolly-15k, dataset:cognitivecomputations/wizard_vicuna_70k_unfiltered, dataset:totally-not-an-llm/EverythingLM-data-V3, dataset:Amod/mental_health_counseling_conversations, dataset:sablo/oasst2_curated, dataset:starfishmedical/webGPT_x_dolly, dataset:Open-Orca/OpenOrca, dataset:mlabonne/chatml_dpo_pairs, base_model:Felladrin/Llama-68M-Chat-v1, base_model:quantized:Felladrin/Llama-68M-Chat-v1, license:apache-2.0, model-index, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: Felladrin/Llama-68M-Chat-v1
Card metadata:
language: en
license: apache-2.0
tags: text-generation, TensorBlock, GGUF
datasets: THUDM/webglm-qa, databricks/databricks-dolly-15k, cognitivecomputations/wizard_vicuna_70k_unfiltered, totally-not-an-llm/EverythingLM-data-V3, Amod/mental_health_counseling_conversations, sablo/oasst2_curated, starfishmedical/webGPT_x_dolly, Open-Orca/OpenOrca, mlabonne/chatml_dpo_pairs
base_model: Felladrin/Llama-68M-Chat-v1
inference: parameters: max_new_tokens: 64
penalty_alpha: 0.5
top_k: 4