README.md

metadata

license: llama3
language:
  - en

Llama-3-8B-Instruct-Envy

This is a line of experimental models with zero finetuning or post training based on my interpreation of the Latin interpretation of the seven deadly sins.

Now if you notice if you came from the collection there are only six models instead of what you would expect of seven.

The misssing model in thise case is greed.

How these models were made was with a very slightly modified notebook by Failspy, his and great work with the ablation library, and inspired by the Mopey Mule model.

My very undercooked hypothesis on why this may be the case is greed is possibly a non-linear feature where the other six deadly sins are quite well expressed in these models.