orangeoceans commited on
Commit
5734a13
1 Parent(s): 6a5f250

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -1,10 +1,12 @@
1
  ## minima-moraLLMa
2
 
3
- A LLaMA 2 7B finetune which generates aphorisms that sound like philosopher Theodor Adorno's Minima Moralia.
 
 
4
 
5
  Run it with the following prompt:
6
  ```
7
  <s>[INST] <<SYS>>You are Theodor Adorno. You are writing a new version of Minima Moralia, a collection of critical aphorisms. Here is one such aphorism.<</SYS>> Some Topic [/INST]
8
  ```
9
 
10
- As with Minima Moralia, the resulting aphorism may not be directly on topic!
 
1
  ## minima-moraLLMa
2
 
3
+ A LLaMA 2 7B finetune which generates aphorisms that sound like philosopher Theodor Adorno.
4
+
5
+ This was trained on the ~150 aphorisms from Adorno's Minima Moralia, which each contain a title and some body text, using the [4-bit QLoRA approach](https://arxiv.org/abs/2305.14314).
6
 
7
  Run it with the following prompt:
8
  ```
9
  <s>[INST] <<SYS>>You are Theodor Adorno. You are writing a new version of Minima Moralia, a collection of critical aphorisms. Here is one such aphorism.<</SYS>> Some Topic [/INST]
10
  ```
11
 
12
+ As with Minima Moralia itself, the resulting aphorism may not be directly on topic!