update readme w compat matrix
Browse files
README.md
CHANGED
@@ -1,6 +1,15 @@
|
|
1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
|
3 |
-
#### You know you're going to axolotl questions
|
4 |
|
5 |
## Getting Started
|
6 |
|
|
|
1 |
+
# Axolotl
|
2 |
+
|
3 |
+
#### Go ahead and axolotl questions
|
4 |
+
|
5 |
+
## Support Matrix
|
6 |
+
|
7 |
+
| | fp16/fp32 | fp16/fp32 w/ lora | 4bit-quant | 4bit-quant w/flash attention | flash attention | xformers attention |
|
8 |
+
|----------|:----------|:------------------|------------|------------------------------|-----------------|--------------------|
|
9 |
+
| llama | β
| β
| β
| β
| β
| β
|
|
10 |
+
| Pythia | β
| β
| β | β | β | β |
|
11 |
+
| cerebras | β
| β
| β | β | β | β |
|
12 |
|
|
|
13 |
|
14 |
## Getting Started
|
15 |
|