alnrg2arg
/

test

Text Generation Transformers Safetensors llama conversational Inference Endpoints text-generation-inference

Model card Files Files and versions Community

Edit model card

This is the test version for pruning. This model is a base model that will be pruned and quantized for on-device purpose.

I used mergekit for merging two models:

https://github.com/cg123/mergekit

The two models I combined are:

Downloads last month: 3,057

Safetensors

Model size

10.7B params

Tensor type

FP16

·