Update README.md
Browse files
README.md
CHANGED
|
@@ -1,24 +1,21 @@
|
|
| 1 |
---
|
| 2 |
-
extra_gated_heading: You need to share contact information with Databricks to access this model
|
| 3 |
-
extra_gated_prompt: >-
|
| 4 |
-
|
| 5 |
-
### DBRX Terms of Use
|
| 6 |
-
|
| 7 |
-
Use of DBRX is governed by the [Databricks Open Model License](https://www.databricks.com/legal/open-model-license) and the [Databricks Open Model Acceptable Use Policy](https://www.databricks.com/legal/acceptable-use-policy-open-model).
|
| 8 |
-
|
| 9 |
-
extra_gated_fields:
|
| 10 |
-
First Name: text
|
| 11 |
-
Last Name: text
|
| 12 |
-
Organization: text
|
| 13 |
-
By clicking 'Submit' below, I accept the terms of the license and acknowledge that the information I provide will be collected, stored, processed, and shared in accordance with Databricks' Privacy Notice and I understand I can update my preferences at any time: checkbox
|
| 14 |
-
extra_gated_description: >-
|
| 15 |
-
The information you provide will be collected, stored, processed, and shared in accordance with Databricks [Privacy Notice](https://www.databricks.com/legal/privacynotice).
|
| 16 |
-
extra_gated_button_content: Submit
|
| 17 |
inference: false
|
| 18 |
license: other
|
| 19 |
license_name: databricks-open-model-license
|
| 20 |
license_link: https://www.databricks.com/legal/open-model-license
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
|
| 23 |
# DBRX Instruct
|
| 24 |
|
|
@@ -167,4 +164,4 @@ Full evaluation details can be found in our [technical blog post](https://www.da
|
|
| 167 |
## Acknowledgements
|
| 168 |
The DBRX models were made possible thanks in large part to the open-source community, especially:
|
| 169 |
* The [MegaBlocks](https://arxiv.org/abs/2211.15841) library, which established a foundation for our MoE implementation.
|
| 170 |
-
* [PyTorch FSDP](https://arxiv.org/abs/2304.11277), which we built on for distributed training.
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
inference: false
|
| 3 |
license: other
|
| 4 |
license_name: databricks-open-model-license
|
| 5 |
license_link: https://www.databricks.com/legal/open-model-license
|
| 6 |
+
tags:
|
| 7 |
+
- dbrx
|
| 8 |
+
- 4bit
|
| 9 |
+
- gptq
|
| 10 |
+
- gptqmodel
|
| 11 |
---
|
| 12 |
+
---
|
| 13 |
+
license: other
|
| 14 |
+
license_name: databricks-open-model-license
|
| 15 |
+
license_link: https://www.databricks.com/legal/open-model-license
|
| 16 |
+
---
|
| 17 |
+
|
| 18 |
+
This model has been quantized using [GPTQModel](https://github.com/ModelCloud/GPTQModel).
|
| 19 |
|
| 20 |
# DBRX Instruct
|
| 21 |
|
|
|
|
| 164 |
## Acknowledgements
|
| 165 |
The DBRX models were made possible thanks in large part to the open-source community, especially:
|
| 166 |
* The [MegaBlocks](https://arxiv.org/abs/2211.15841) library, which established a foundation for our MoE implementation.
|
| 167 |
+
* [PyTorch FSDP](https://arxiv.org/abs/2304.11277), which we built on for distributed training.
|