Fix(docs): Remove gptq+lora and fix xformer compat list (#423)
Browse files
README.md
CHANGED
|
@@ -49,15 +49,15 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, o
|
|
| 49 |
|
| 50 |
## Axolotl supports
|
| 51 |
|
| 52 |
-
| | fp16/fp32 | lora | qlora | gptq | gptq w/
|
| 53 |
-
|
| 54 |
-
| llama | β
| β
| β
| β
|
| 55 |
-
| Pythia | β
| β
| β
| β
|
| 56 |
-
| cerebras | β
| β
| β
| β
|
| 57 |
-
| mpt | β
| β | β | β
|
| 58 |
-
| falcon | β
| β
| β
| β
|
| 59 |
-
| gpt-j | β
| β
| β
| β
|
| 60 |
-
| XGen | β
| β | β
| β
|
| 61 |
|
| 62 |
|
| 63 |
## Quickstart β‘
|
|
|
|
| 49 |
|
| 50 |
## Axolotl supports
|
| 51 |
|
| 52 |
+
| | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn |
|
| 53 |
+
|----------|:----------|:-----|-------|------|-------------------|------------|---------------|
|
| 54 |
+
| llama | β
| β
| β
| β
| β
| β
| β
|
|
| 55 |
+
| Pythia | β
| β
| β
| β | β | β | β |
|
| 56 |
+
| cerebras | β
| β
| β
| β | β | β | β |
|
| 57 |
+
| mpt | β
| β | β | β | β | β | β |
|
| 58 |
+
| falcon | β
| β
| β
| β | β | β | β |
|
| 59 |
+
| gpt-j | β
| β
| β
| β | β | β | β |
|
| 60 |
+
| XGen | β
| β | β
| β | β | β | β
|
|
| 61 |
|
| 62 |
|
| 63 |
## Quickstart β‘
|