Hugging Face's logo

zrowt
/
results

Text Classification
Transformers
TensorBoard
Safetensors
llama
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
zrowt commited on
Commit
e1055e4
•
1 Parent(s): 8891871

Example-Modelss

Browse files
Files changed (29) hide show
  1. README.md +6 -9
  2. config.json +30 -60
  3. model.safetensors +2 -2
  4. runs/Apr25_01-01-40_Zacs-Mac-mini.local/events.out.tfevents.1714024901.Zacs-Mac-mini.local.64389.0 +3 -0
  5. runs/Apr25_01-05-07_Zacs-Mac-mini.local/events.out.tfevents.1714025108.Zacs-Mac-mini.local.67341.0 +3 -0
  6. runs/Apr25_01-11-39_Zacs-Mac-mini.local/events.out.tfevents.1714025600.Zacs-Mac-mini.local.71399.0 +3 -0
  7. runs/Apr25_09-51-17_Zacs-Mac-mini.local/events.out.tfevents.1714056784.Zacs-Mac-mini.local.92572.0 +3 -0
  8. runs/Apr25_10-34-00_Zacs-Mac-mini.local/events.out.tfevents.1714059344.Zacs-Mac-mini.local.19664.0 +3 -0
  9. runs/Apr25_10-43-25_Zacs-Mac-mini.local/events.out.tfevents.1714059910.Zacs-Mac-mini.local.25725.0 +3 -0
  10. runs/Apr25_11-11-46_Zacs-Mac-mini.local/events.out.tfevents.1714061610.Zacs-Mac-mini.local.43984.0 +3 -0
  11. runs/Apr25_11-42-11_Zacs-Mac-mini.local/events.out.tfevents.1714063436.Zacs-Mac-mini.local.63253.0 +3 -0
  12. runs/Apr25_11-54-20_Zacs-Mac-mini.local/events.out.tfevents.1714064168.Zacs-Mac-mini.local.71293.0 +3 -0
  13. runs/Apr26_10-41-27_Zacs-Mac-mini.local/events.out.tfevents.1714146191.Zacs-Mac-mini.local.45790.0 +3 -0
  14. runs/Apr26_10-44-37_Zacs-Mac-mini.local/events.out.tfevents.1714146381.Zacs-Mac-mini.local.48067.0 +3 -0
  15. runs/Apr26_10-49-41_Zacs-Mac-mini.local/events.out.tfevents.1714146685.Zacs-Mac-mini.local.51334.0 +3 -0
  16. runs/Apr26_10-56-49_Zacs-Mac-mini.local/events.out.tfevents.1714147010.Zacs-Mac-mini.local.56278.0 +3 -0
  17. runs/Apr26_10-58-18_Zacs-Mac-mini.local/events.out.tfevents.1714147099.Zacs-Mac-mini.local.57294.0 +3 -0
  18. runs/Apr26_11-00-32_Zacs-Mac-mini.local/events.out.tfevents.1714147233.Zacs-Mac-mini.local.58813.0 +3 -0
  19. runs/Apr26_11-03-43_Zacs-Mac-mini.local/events.out.tfevents.1714147424.Zacs-Mac-mini.local.60807.0 +3 -0
  20. runs/Apr26_11-04-46_Zacs-Mac-mini.local/events.out.tfevents.1714147487.Zacs-Mac-mini.local.61540.0 +3 -0
  21. runs/Apr26_11-24-19_Zacs-Mac-mini.local/events.out.tfevents.1714148660.Zacs-Mac-mini.local.73736.0 +3 -0
  22. runs/Apr26_11-25-31_Zacs-Mac-mini.local/events.out.tfevents.1714148732.Zacs-Mac-mini.local.74224.0 +3 -0
  23. runs/Apr26_11-27-24_Zacs-Mac-mini.local/events.out.tfevents.1714148845.Zacs-Mac-mini.local.74940.0 +3 -0
  24. runs/Apr26_11-42-56_Zacs-Mac-mini.local/events.out.tfevents.1714149777.Zacs-Mac-mini.local.80709.0 +3 -0
  25. runs/Apr26_11-55-34_Zacs-Mac-mini.local/events.out.tfevents.1714150535.Zacs-Mac-mini.local.85464.0 +3 -0
  26. runs/Apr26_11-56-27_Zacs-Mac-mini.local/events.out.tfevents.1714150588.Zacs-Mac-mini.local.85841.0 +3 -0
  27. runs/Apr26_11-58-46_Zacs-Mac-mini.local/events.out.tfevents.1714150727.Zacs-Mac-mini.local.86835.0 +3 -0
  28. runs/Apr26_12-03-09_Zacs-Mac-mini.local/events.out.tfevents.1714150990.Zacs-Mac-mini.local.88701.0 +3 -0
  29. training_args.bin +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- base_model: google-bert/bert-base-cased
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # results
15
 
16
- This model is a fine-tuned version of [google-bert/bert-base-cased](https://huggingface.co/google-bert/bert-base-cased) on an unknown dataset.
17
 
18
  ## Model description
19
 
@@ -32,24 +32,21 @@ More information needed
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
- - learning_rate: 2e-05
36
  - train_batch_size: 1
37
- - eval_batch_size: 1
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
- - num_epochs: 1
42
 
43
  ### Training results
44
 
45
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
46
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
47
- | No log | 1.0 | 18 | 3.2827 | 0.0 |
48
 
49
 
50
  ### Framework versions
51
 
52
  - Transformers 4.39.3
53
- - Pytorch 2.2.2+cpu
54
  - Datasets 2.19.0
55
  - Tokenizers 0.15.2
 
1
  ---
2
  license: apache-2.0
3
+ base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
13
 
14
  # results
15
 
16
+ This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on an unknown dataset.
17
 
18
  ## Model description
19
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 5e-05
36
  - train_batch_size: 1
37
+ - eval_batch_size: 8
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 3.0
42
 
43
  ### Training results
44
 
 
 
 
45
 
46
 
47
  ### Framework versions
48
 
49
  - Transformers 4.39.3
50
+ - Pytorch 2.2.2
51
  - Datasets 2.19.0
52
  - Tokenizers 0.15.2
config.json CHANGED
@@ -1,73 +1,43 @@
1
  {
2
- "_name_or_path": "google-bert/bert-base-cased",
3
  "architectures": [
4
- "BertForSequenceClassification"
5
  ],
6
- "attention_probs_dropout_prob": 0.1,
7
- "classifier_dropout": null,
8
- "gradient_checkpointing": false,
9
- "hidden_act": "gelu",
10
- "hidden_dropout_prob": 0.1,
11
- "hidden_size": 768,
12
  "id2label": {
13
- "0": "28",
14
- "1": "Audi",
15
- "2": "Bohemian Rhapsody",
16
- "3": "Breaking Bad",
17
- "4": "Christmas",
18
- "5": "Diving",
19
- "6": "England",
20
- "7": "Erica Heon's Pizza",
21
- "8": "Harry Potter",
22
- "9": "Interstellar",
23
- "10": "London",
24
- "11": "Mac",
25
- "12": "Minecraft",
26
- "13": "Monster Energy Drink",
27
- "14": "Playstation",
28
- "15": "Programming",
29
- "16": "Purple & Gold **geaux tigers**",
30
- "17": "Tex & Kylie",
31
- "18": "The Beatles",
32
- "19": "Zak 'The Man' Rowton",
33
- "20": "iPhone"
34
  },
35
  "initializer_range": 0.02,
36
- "intermediate_size": 3072,
37
  "label2id": {
38
- "28": 0,
39
- "Audi": 1,
40
- "Bohemian Rhapsody": 2,
41
- "Breaking Bad": 3,
42
- "Christmas": 4,
43
- "Diving": 5,
44
- "England": 6,
45
- "Erica Heon's Pizza": 7,
46
- "Harry Potter": 8,
47
- "Interstellar": 9,
48
- "London": 10,
49
- "Mac": 11,
50
- "Minecraft": 12,
51
- "Monster Energy Drink": 13,
52
- "Playstation": 14,
53
- "Programming": 15,
54
- "Purple & Gold **geaux tigers**": 16,
55
- "Tex & Kylie": 17,
56
- "The Beatles": 18,
57
- "Zak 'The Man' Rowton": 19,
58
- "iPhone": 20
59
  },
60
- "layer_norm_eps": 1e-12,
61
- "max_position_embeddings": 512,
62
- "model_type": "bert",
63
- "num_attention_heads": 12,
64
- "num_hidden_layers": 12,
65
- "pad_token_id": 0,
66
- "position_embedding_type": "absolute",
67
  "problem_type": "single_label_classification",
 
 
 
 
68
  "torch_dtype": "float32",
69
  "transformers_version": "4.39.3",
70
- "type_vocab_size": 2,
71
  "use_cache": true,
72
- "vocab_size": 28996
73
  }
 
1
  {
2
+ "_name_or_path": "TinyLlama/TinyLlama-1.1B-Chat-v1.0",
3
  "architectures": [
4
+ "LlamaForSequenceClassification"
5
  ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 2048,
12
  "id2label": {
13
+ "0": "LABEL_0",
14
+ "1": "LABEL_1",
15
+ "2": "LABEL_2",
16
+ "3": "LABEL_3",
17
+ "4": "LABEL_4"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  },
19
  "initializer_range": 0.02,
20
+ "intermediate_size": 5632,
21
  "label2id": {
22
+ "LABEL_0": 0,
23
+ "LABEL_1": 1,
24
+ "LABEL_2": 2,
25
+ "LABEL_3": 3,
26
+ "LABEL_4": 4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
  },
28
+ "max_position_embeddings": 2048,
29
+ "model_type": "llama",
30
+ "num_attention_heads": 32,
31
+ "num_hidden_layers": 22,
32
+ "num_key_value_heads": 4,
33
+ "pretraining_tp": 1,
 
34
  "problem_type": "single_label_classification",
35
+ "rms_norm_eps": 1e-05,
36
+ "rope_scaling": null,
37
+ "rope_theta": 10000.0,
38
+ "tie_word_embeddings": false,
39
  "torch_dtype": "float32",
40
  "transformers_version": "4.39.3",
 
41
  "use_cache": true,
42
+ "vocab_size": 32000
43
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f64908e63038e6177bf4f61724303ae3a3b6b259b330a28cb8733c33c5e842be
3
- size 433329212
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:579f6072a6ea2877f65fe25d12c5f448df64a56ee39171bf52e54a483d368faa
3
+ size 4138113456
runs/Apr25_01-01-40_Zacs-Mac-mini.local/events.out.tfevents.1714024901.Zacs-Mac-mini.local.64389.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:120cffcc425b3cbb575aabe3fbf7c9c54296152482d5c0861409b6f9a1cf65e9
3
+ size 4873
runs/Apr25_01-05-07_Zacs-Mac-mini.local/events.out.tfevents.1714025108.Zacs-Mac-mini.local.67341.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:573779cee4a4d65a72a054df2e01941d0a98d54afb3284dade20dcab95b45460
3
+ size 4873
runs/Apr25_01-11-39_Zacs-Mac-mini.local/events.out.tfevents.1714025600.Zacs-Mac-mini.local.71399.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ddaddfc89329cc1d635d3f81371c1e15880a03429bb401972845fb4cebd5cd4
3
+ size 4878
runs/Apr25_09-51-17_Zacs-Mac-mini.local/events.out.tfevents.1714056784.Zacs-Mac-mini.local.92572.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a419b9d1384cf7fc15675c29d3c7e0dae1c7e1e3aaadde5fa1e4171e2bc35c3
3
+ size 4878
runs/Apr25_10-34-00_Zacs-Mac-mini.local/events.out.tfevents.1714059344.Zacs-Mac-mini.local.19664.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f6a9252654883b1832b16a38261b816a543c789ae78030a819272c87d2842da
3
+ size 4878
runs/Apr25_10-43-25_Zacs-Mac-mini.local/events.out.tfevents.1714059910.Zacs-Mac-mini.local.25725.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:062323c1f4d72b698ce913e5c580db1260038ce1a88d283d280a23a8fc17122b
3
+ size 4878
runs/Apr25_11-11-46_Zacs-Mac-mini.local/events.out.tfevents.1714061610.Zacs-Mac-mini.local.43984.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b120bb06fb772aee3db2eb39cca4e99ac583063e460da35625399b2016a55c39
3
+ size 4877
runs/Apr25_11-42-11_Zacs-Mac-mini.local/events.out.tfevents.1714063436.Zacs-Mac-mini.local.63253.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec8a1dea091e739721db4dd6a9ea622dbf7b8da88d895a577576205c0a40ae07
3
+ size 4877
runs/Apr25_11-54-20_Zacs-Mac-mini.local/events.out.tfevents.1714064168.Zacs-Mac-mini.local.71293.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1632ce3e726d3e72864726f4aa90739f3ceb65f52bf3d734e9db608231eb3062
3
+ size 4887
runs/Apr26_10-41-27_Zacs-Mac-mini.local/events.out.tfevents.1714146191.Zacs-Mac-mini.local.45790.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a54bbf3a1f0553be8161e1a32ddfd53286b684bd1906a5ad35ed3195f4a5a9f1
3
+ size 4887
runs/Apr26_10-44-37_Zacs-Mac-mini.local/events.out.tfevents.1714146381.Zacs-Mac-mini.local.48067.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddef183d8737296b265515638801218edf34844611a7f487fdbba3b5d3db600d
3
+ size 4878
runs/Apr26_10-49-41_Zacs-Mac-mini.local/events.out.tfevents.1714146685.Zacs-Mac-mini.local.51334.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:280fd2c32a30fcb6beedbb24afd280699f818ec0dd84bd21d17ac87728af860b
3
+ size 4878
runs/Apr26_10-56-49_Zacs-Mac-mini.local/events.out.tfevents.1714147010.Zacs-Mac-mini.local.56278.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f94689a94ce365f0fe58b53551dee7874eb7b8012d9ff852611c498751784375
3
+ size 4873
runs/Apr26_10-58-18_Zacs-Mac-mini.local/events.out.tfevents.1714147099.Zacs-Mac-mini.local.57294.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60bd4baa9154f696f62c2d4e8b0bd26f635922f4a7d03c7e25a7a87450420ea0
3
+ size 4873
runs/Apr26_11-00-32_Zacs-Mac-mini.local/events.out.tfevents.1714147233.Zacs-Mac-mini.local.58813.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a42e3388eca63bcb77154fd048c960523785145731240082860f7ecc49174408
3
+ size 4870
runs/Apr26_11-03-43_Zacs-Mac-mini.local/events.out.tfevents.1714147424.Zacs-Mac-mini.local.60807.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10c94cec2827bb5e5133695d35bd380c2efe1c2da4d693abeaa148af9e0022ac
3
+ size 4870
runs/Apr26_11-04-46_Zacs-Mac-mini.local/events.out.tfevents.1714147487.Zacs-Mac-mini.local.61540.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:848e1bbe7e56297bed6f0b224eff39f41e9c416b3f02d812ecc151eaa82b8d64
3
+ size 5503
runs/Apr26_11-24-19_Zacs-Mac-mini.local/events.out.tfevents.1714148660.Zacs-Mac-mini.local.73736.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e8deed22c543cd2243f91323ff149074749f7871a2961d4b998a2f892dbab9d
3
+ size 4878
runs/Apr26_11-25-31_Zacs-Mac-mini.local/events.out.tfevents.1714148732.Zacs-Mac-mini.local.74224.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa8cb63a500d8e06fa9d80ca3916f63f88490d19c704d98fe5cacc4f27dd928f
3
+ size 4878
runs/Apr26_11-27-24_Zacs-Mac-mini.local/events.out.tfevents.1714148845.Zacs-Mac-mini.local.74940.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47322cd3c65bbf775be795c5ae607b6a9e906ebbe97d9b561b39e64b844bd733
3
+ size 4870
runs/Apr26_11-42-56_Zacs-Mac-mini.local/events.out.tfevents.1714149777.Zacs-Mac-mini.local.80709.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7f12e23c4e952f1fbfacd39813f953a5e5dcf1b2d114b8cff082bb4e0bf201b
3
+ size 4870
runs/Apr26_11-55-34_Zacs-Mac-mini.local/events.out.tfevents.1714150535.Zacs-Mac-mini.local.85464.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7aab7f7a780552229d235e9e4ac0f7518aafeeafc9e628e28a74fc7d3ab75f13
3
+ size 4870
runs/Apr26_11-56-27_Zacs-Mac-mini.local/events.out.tfevents.1714150588.Zacs-Mac-mini.local.85841.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4813939ec4f6912bc77700ca5a19a18fb197df3d871fa48f0d396c6ab910737b
3
+ size 4870
runs/Apr26_11-58-46_Zacs-Mac-mini.local/events.out.tfevents.1714150727.Zacs-Mac-mini.local.86835.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3acd5db5b8a173ab05d0b50cf1f2c39464f4d5b83f558ac3a52606a7062e6daa
3
+ size 5222
runs/Apr26_12-03-09_Zacs-Mac-mini.local/events.out.tfevents.1714150990.Zacs-Mac-mini.local.88701.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39dec4f3489dbda5a01c20b947243d9c3ff59201456a82d7801e80eb2e6d46bb
3
+ size 5222
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4e7275ea9852247fc5e165e4a324391e9a8403083432d196e7175dff959b16a1
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1029867f60f0f5e47e4467f60996431a3eea8e1c9b979c52661f01a27ff85fdd
3
  size 4920