Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
cognitivecomputations
/
dolphin-2.9-llama3-8b-256k
like
45
Follow
Cognitive Computations
1.28k
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
License:
llama3
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
Was trying to quantize to 8 bits to reduce VRAM footprint. Got the stuff below.
#3
by
BigDeeper
- opened
May 1, 2024
Discussion
BigDeeper
May 1, 2024
This comment has been hidden
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
