appvoid commited on
Commit
9f8ca35
1 Parent(s): 1c85f88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,7 +1,7 @@
1
  # palmer
2
  ### a better base model
3
  palmer is a series of ~1b parameters language models fine-tuned to be used as base models instead of using custom prompts for tasks. This means that it can be further fine-tuned on more data with custom prompts as usual or be used for downstream tasks as any base model you can get. The model has the best of both worlds: some "bias" to act as an assistant, but also the abillity to predict the next-word from its internet knowledge base.
4
- Training took ~3.5 P100 gpu hours. It was trained on 15,000 openhermes dataset shuffled samples.
5
 
6
  ### Prompt
7
  ```
 
1
  # palmer
2
  ### a better base model
3
  palmer is a series of ~1b parameters language models fine-tuned to be used as base models instead of using custom prompts for tasks. This means that it can be further fine-tuned on more data with custom prompts as usual or be used for downstream tasks as any base model you can get. The model has the best of both worlds: some "bias" to act as an assistant, but also the abillity to predict the next-word from its internet knowledge base.
4
+ Training took ~3.5 P100 gpu hours. It was trained on 15,000 openhermes dataset shuffled samples. It's a llama 2 model so you can use it with your favorite tools/frameworks.
5
 
6
  ### Prompt
7
  ```