pszemraj commited on
Commit
752efd1
1 Parent(s): d41b375

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -42
README.md CHANGED
@@ -2,7 +2,10 @@
2
  license: apache-2.0
3
  base_model: pszemraj/tinyllama-1.1b-3T
4
  tags:
5
- - generated_from_trainer
 
 
 
6
  metrics:
7
  - accuracy
8
  inference:
@@ -16,35 +19,39 @@ inference:
16
  top_p: 0.95
17
  epsilon_cutoff: 0.0008
18
  widget:
19
- - text: In beekeeping, the term "queen excluder" refers to
20
- example_title: Queen Excluder
21
- - text: One way to encourage a honey bee colony to produce more honey is by
22
- example_title: Increasing Honey Production
23
- - text: The lifecycle of a worker bee consists of several stages, starting with
24
- example_title: Lifecycle of a Worker Bee
25
- - text: Varroa destructor is a type of mite that
26
- example_title: Varroa Destructor
27
- - text: In the world of beekeeping, the acronym PPE stands for
28
- example_title: Beekeeping PPE
29
- - text: The term "robbing" in beekeeping refers to the act of
30
- example_title: Robbing in Beekeeping
31
- - text: |-
32
- Question: What's the primary function of drone bees in a hive?
33
- Answer:
34
- example_title: Role of Drone Bees
35
- - text: To harvest honey from a hive, beekeepers often use a device known as a
36
- example_title: Honey Harvesting Device
37
- - text: >-
38
- Problem: You have a hive that produces 60 pounds of honey per year. You
39
- decide to split the hive into two. Assuming each hive now produces at a
40
- 70% rate compared to before, how much honey will you get from both hives
41
- next year?
42
-
43
- To calculate
44
- example_title: Beekeeping Math Problem
45
- - text: In beekeeping, "swarming" is the process where
46
- example_title: Swarming
47
  pipeline_tag: text-generation
 
 
 
 
48
  ---
49
 
50
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -52,24 +59,20 @@ should probably proofread and complete it, then remove this comment. -->
52
 
53
  # TinyLlama-3T-1.1bee
54
 
55
- This model is a fine-tuned version of [pszemraj/tinyllama-1.1b-3T](https://huggingface.co/pszemraj/tinyllama-1.1b-3T) on the BEE-spoke-data/bees-internal dataset.
56
- It achieves the following results on the evaluation set:
57
- - Loss: 2.1640
58
- - Accuracy: 0.5406
59
-
60
- ## Model description
61
 
62
- More information needed
63
 
64
- ## Intended uses & limitations
 
65
 
66
- More information needed
67
 
68
- ## Training and evaluation data
69
 
70
- More information needed
71
 
72
- ## Training procedure
 
 
73
 
74
  ### Training hyperparameters
75
 
@@ -106,4 +109,4 @@ The following hyperparameters were used during training:
106
  - Transformers 4.36.2
107
  - Pytorch 2.1.0
108
  - Datasets 2.16.1
109
- - Tokenizers 0.15.0
 
2
  license: apache-2.0
3
  base_model: pszemraj/tinyllama-1.1b-3T
4
  tags:
5
+ - bees
6
+ - bzz
7
+ - honey
8
+ - oprah winfrey
9
  metrics:
10
  - accuracy
11
  inference:
 
19
  top_p: 0.95
20
  epsilon_cutoff: 0.0008
21
  widget:
22
+ - text: In beekeeping, the term "queen excluder" refers to
23
+ example_title: Queen Excluder
24
+ - text: One way to encourage a honey bee colony to produce more honey is by
25
+ example_title: Increasing Honey Production
26
+ - text: The lifecycle of a worker bee consists of several stages, starting with
27
+ example_title: Lifecycle of a Worker Bee
28
+ - text: Varroa destructor is a type of mite that
29
+ example_title: Varroa Destructor
30
+ - text: In the world of beekeeping, the acronym PPE stands for
31
+ example_title: Beekeeping PPE
32
+ - text: The term "robbing" in beekeeping refers to the act of
33
+ example_title: Robbing in Beekeeping
34
+ - text: |-
35
+ Question: What's the primary function of drone bees in a hive?
36
+ Answer:
37
+ example_title: Role of Drone Bees
38
+ - text: To harvest honey from a hive, beekeepers often use a device known as a
39
+ example_title: Honey Harvesting Device
40
+ - text: >-
41
+ Problem: You have a hive that produces 60 pounds of honey per year. You
42
+ decide to split the hive into two. Assuming each hive now produces at a 70%
43
+ rate compared to before, how much honey will you get from both hives next
44
+ year?
45
+
46
+ To calculate
47
+ example_title: Beekeeping Math Problem
48
+ - text: In beekeeping, "swarming" is the process where
49
+ example_title: Swarming
50
  pipeline_tag: text-generation
51
+ datasets:
52
+ - BEE-spoke-data/bees-internal
53
+ language:
54
+ - en
55
  ---
56
 
57
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
59
 
60
  # TinyLlama-3T-1.1bee
61
 
 
 
 
 
 
 
62
 
63
+ A grand successor to [the original](https://huggingface.co/BEE-spoke-data/TinyLlama-1.1bee). This one has the following improvements:
64
 
65
+ - start from [finished 3T TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T)
66
+ - vastly improved and expanded SoTA beekeeping dataset
67
 
 
68
 
69
+ ## Model description
70
 
71
+ This model is a fine-tuned version of TinyLlama-1.1b-3T on the BEE-spoke-data/bees-internal dataset.
72
 
73
+ It achieves the following results on the evaluation set:
74
+ - Loss: 2.1640
75
+ - Accuracy: 0.5406
76
 
77
  ### Training hyperparameters
78
 
 
109
  - Transformers 4.36.2
110
  - Pytorch 2.1.0
111
  - Datasets 2.16.1
112
+ - Tokenizers 0.15.0