PrunaAI
/

cognitivecomputations-dolphin-2.9-llama3-8b-256k-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

cognitivecomputations-dolphin-2.9-llama3-8b-256k-AWQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad

15c47a4 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.47 kB

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
config.json

867 Bytes

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
generation_config.json

142 Bytes

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
model-00001-of-00002.safetensors

4.68 GB
LFS

753516a1aabdd2762f1b6ebad11ba23b37f33f9b54d05863d5f9ecdf830753f3 7 months ago
model-00002-of-00002.safetensors

1.05 GB
LFS

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
model.safetensors.index.json

63.5 kB

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
plots.png

613 kB

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
results.json

1.74 kB

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago
smash_config.json

1.03 kB

a4e6f8f1c177a8652be1bd14f1ea557e28c78b0e56cba306a1dca09cb58470ad 7 months ago