crumb commited on
Commit
522c000
1 Parent(s): 0989769

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -4
README.md CHANGED
@@ -3,9 +3,7 @@ license: apache-2.0
3
  datasets:
4
  - crumb/C4-K8-1M
5
  ---
6
- (WIP) 8 pythia-160m models ("cortices") making up a mixture of experts adding to a total storage of 1280m (1.28b) parameters, wip name "cloyster" because i thought it was funny and it has the ability "skill link" and sounds like cluster
7
-
8
- A dedicated inference codebase is not completed yet, this model being created will neccesitate it
9
 
10
  ### Predicted Expert Domains
11
 
@@ -18,4 +16,28 @@ Automatically generated classes (based on a very small subset of data) (actually
18
  4. Business communication and digital marketing
19
  5. Commerce and consumerism
20
  6. Economics, politics, sports, and current events
21
- 7. Science and Technology
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  datasets:
4
  - crumb/C4-K8-1M
5
  ---
6
+ (WIP) 8 pythia-160m models ("cortices") making up a mixture of experts adding to a total storage of 1280m (1.28b) parameters, trained on [crumb/C4-K8-1M](https://hf.co/datasets/crumb/C4-K8-1M) for 1 epoch (way too little, bigger dataset soon).
 
 
7
 
8
  ### Predicted Expert Domains
9
 
 
16
  4. Business communication and digital marketing
17
  5. Commerce and consumerism
18
  6. Economics, politics, sports, and current events
19
+ 7. Science and Technology
20
+
21
+ ### Example Output
22
+
23
+ Better evaluation coming soon (tm). Uniform sampling was used (sum(logits)/8) with temperature 0.7, top_p 0.95, top_k 28. Prompt "Once upon a time," max_new_tokens=128
24
+
25
+ ```
26
+ Once upon a time, I’ve made it a point to clean dishes in front of an illuminated grout pan for cooktop preparation, and I’ve just been enjoying that process on my back. The inner work of cleaning a grout pan is more creative and requires less than the usual amount of patience and desire. This is one of the reasons my kitchen becomes so refined and inflexible with the same grout pan.
27
+ The latest gadget in this latest trend has been Vivalant, or of course Vivalant-based. Vivalant allows you to use grout at its cooking and utensils, because it’s a
28
+ ```
29
+
30
+ ```
31
+ Once upon a time, as a regular walk through the area, I had no idea how very many things were going on.
32
+ I was surprised to find this same area looking much different after a few days.
33
+ Just what I expected when I went to the closest city of Marietta. It's been a few weeks now since I visited Marietta and was once again struck by its weather.
34
+ I don't know what's better, but the beautiful white gauze in this photograph is gorgeous!
35
+ I look at the weather, and the growing shapes of the sky as one moves toward the shore.
36
+ Perhaps the harbor is an air-conditioned place,
37
+ ```
38
+
39
+ ```
40
+ Once upon a time, we weren’t really talking about one of the broads most popular mini-games on the planet. Even the Red Dead Redemption is known for being as varied as half-teaser Monopoly, F2P and Secret Weapon. But does anyone know the half-truth of their power source that the Red Dead Redemption is built on? What’s behind the story of the new stealth film?
41
+ The game is no different. It is known for its zombies that capture some magic and take them on the battlefield.
42
+ However, I think the answer may be no. I think I’ve never seen the
43
+ ```