ibivibiv commited on
Commit
10236d2
1 Parent(s): eb62904

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ tags:
7
  ---
8
  # Chimera 120b
9
 
10
- ![img](./athena.png)
11
 
12
  An auto-regressive causal LM created by combining 3x finetuned models into one via passthrough merging slices in a stacked order. This model is a sliced passthrough merge of Sheep Duck, Xwin, and Sythia. I wanted to make Sheep Duck part of Giant Macaroni but the Marconi and Sheep Duck models don't line up (I think because of the rotary embedding). Honestly, without the fine tuning yet, I think this model might be slightly better at my logic and reason tests. I'll try to update more here as I go and release more versions as I can fine tune these more.
13
 
 
7
  ---
8
  # Chimera 120b
9
 
10
+ ![img](./chimera.png)
11
 
12
  An auto-regressive causal LM created by combining 3x finetuned models into one via passthrough merging slices in a stacked order. This model is a sliced passthrough merge of Sheep Duck, Xwin, and Sythia. I wanted to make Sheep Duck part of Giant Macaroni but the Marconi and Sheep Duck models don't line up (I think because of the rotary embedding). Honestly, without the fine tuning yet, I think this model might be slightly better at my logic and reason tests. I'll try to update more here as I go and release more versions as I can fine tune these more.
13