Hugging Face's logo

pszemraj
/
mega-ar-small-4096-wikitext-103-raw-v1

Text Generation
Transformers
PyTorch
Safetensors
English
mega
Generated from Trainer
Inference Endpoints
Model card Files Community
1
pszemraj commited on
Commit
f3be843
•
1 Parent(s): b0b9a37

Training in progress, step 100

Browse files
Files changed (3) hide show
  1. config.json +1 -1
  2. pytorch_model.bin +2 -2
  3. training_args.bin +1 -1
config.json CHANGED
@@ -1,7 +1,7 @@
1
  {
2
  "_name_or_path": "pszemraj/random-mega-ar-small-4096",
3
  "activation": "silu",
4
- "add_lm_hidden_dense_layer": true,
5
  "add_token_type_embeddings": false,
6
  "architectures": [
7
  "MegaForCausalLM"
 
1
  {
2
  "_name_or_path": "pszemraj/random-mega-ar-small-4096",
3
  "activation": "silu",
4
+ "add_lm_hidden_dense_layer": false,
5
  "add_token_type_embeddings": false,
6
  "architectures": [
7
  "MegaForCausalLM"
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6dc2003045ab372c69c777632be85a9d190e5de2fcfce4abf96b8827a44535df
3
- size 260336250
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98623f2c94a0cbb577203562d42b5f2e249f307fac856424c96f4b314675d983
3
+ size 259284978
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c478269ef53582b4f1c1a1ef7b3a24cd3db17520da41d57055aef162178e72d9
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a0505fcb20c605b28b64edf72a51d667472aaadef16cbfd5edfb273c79b2a4b
3
  size 4728