xzuyn's picture
Update README.md
3dd187e verified
|
raw
history blame
749 Bytes
metadata
language:
  - en

https://gist.github.com/xzuyn/106324ba725a8bfc20d6041be904088b

----Zeroed Layers----
model.layers.3.self_attn.o_proj.weight
model.layers.3.mlp.down_proj.weight
model.layers.7.self_attn.o_proj.weight
model.layers.7.mlp.down_proj.weight
model.layers.11.self_attn.o_proj.weight
model.layers.11.mlp.down_proj.weight
model.layers.15.self_attn.o_proj.weight
model.layers.15.mlp.down_proj.weight
model.layers.19.self_attn.o_proj.weight
model.layers.19.mlp.down_proj.weight
model.layers.23.self_attn.o_proj.weight
model.layers.23.mlp.down_proj.weight
model.layers.27.self_attn.o_proj.weight
model.layers.27.mlp.down_proj.weight
model.layers.31.self_attn.o_proj.weight
model.layers.31.mlp.down_proj.weight
----Zeroed Layers----