Edit model card

This is an instruct model. It's to test out the effects of my dataset on the InternLM model if you just change everything to say "Llama" instead of "InternLM" in the config files.

I had a theory that a lot of these models are just Llama models with extraneous loaders. This is to test that theory.

Trained at rank 256 for 1 epoch at constant learning rate.

Downloads last month: 58

Safetensors

Model size

20.1B params

Tensor type

FP16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.