Fix(docs): Remove gptq+lora and fix xformer compat list (#423)
Browse files
README.md
CHANGED
|
@@ -49,15 +49,15 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, o
|
|
| 49 |
|
| 50 |
## Axolotl supports
|
| 51 |
|
| 52 |
-
| | fp16/fp32 | lora | qlora | gptq | gptq w/
|
| 53 |
-
|
| 54 |
-
| llama | ✅ | ✅ | ✅ | ✅
|
| 55 |
-
| Pythia | ✅ | ✅ | ✅ | ❌
|
| 56 |
-
| cerebras | ✅ | ✅ | ✅ | ❌
|
| 57 |
-
| mpt | ✅ | ❌ | ❓ | ❌
|
| 58 |
-
| falcon | ✅ | ✅ | ✅ | ❌
|
| 59 |
-
| gpt-j | ✅ | ✅ | ✅ | ❌
|
| 60 |
-
| XGen | ✅ | ❓ | ✅ | ❓
|
| 61 |
|
| 62 |
|
| 63 |
## Quickstart ⚡
|
|
|
|
| 49 |
|
| 50 |
## Axolotl supports
|
| 51 |
|
| 52 |
+
| | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn |
|
| 53 |
+
|----------|:----------|:-----|-------|------|-------------------|------------|---------------|
|
| 54 |
+
| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
|
| 55 |
+
| Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
|
| 56 |
+
| cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
|
| 57 |
+
| mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ |
|
| 58 |
+
| falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
|
| 59 |
+
| gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ❓ |
|
| 60 |
+
| XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ✅ |
|
| 61 |
|
| 62 |
|
| 63 |
## Quickstart ⚡
|