jploski commited on
Commit
d7c4243
2 Parent(s): 6178a8f 566a7e5

Merge branch 'main' of https://huggingface.co/jploski/mpt-mini-shakespeare into main

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -11,15 +11,15 @@ should probably proofread and complete it, then remove this comment. -->
11
 
12
  # mpt-mini-shakespeare
13
 
14
- This model was trained from scratch on an unknown dataset.
15
 
16
  ## Model description
17
 
18
- More information needed
19
 
20
  ## Intended uses & limitations
21
 
22
- More information needed
23
 
24
  ## Training and evaluation data
25
 
@@ -27,6 +27,8 @@ More information needed
27
 
28
  ## Training procedure
29
 
 
 
30
  ### Training hyperparameters
31
 
32
  The following hyperparameters were used during training:
@@ -43,7 +45,7 @@ The following hyperparameters were used during training:
43
 
44
  ### Training results
45
 
46
-
47
 
48
  ### Framework versions
49
 
 
11
 
12
  # mpt-mini-shakespeare
13
 
14
+ This model was trained from scratch on https://raw.githubusercontent.com/karpathy/char-rnn/master/data/tinyshakespeare/input.txt.
15
 
16
  ## Model description
17
 
18
+ The configuration and code is adapted from mosaicml/mpt-7b-storywriter, with configuration parameters changed to make it a very tiny model.
19
 
20
  ## Intended uses & limitations
21
 
22
+ Intended just to aid debugging efforts of a GGML port of mpt-7b-storywriter.
23
 
24
  ## Training and evaluation data
25
 
 
27
 
28
  ## Training procedure
29
 
30
+ Just use the single tinyshakespeare text file as both training and validation set (splitting into paragraphs).
31
+
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
 
45
 
46
  ### Training results
47
 
48
+ Mediocre, as expected.
49
 
50
  ### Framework versions
51