| license: apache-2.0 | |
| pipeline_tag: text-generation | |
| tags: | |
| - code | |
| Currently Ctranslate2 does not directly support mistral and zephyr models for conversion | |
| Here is a custom converted model made possible by some code changes to the ct2 repo for mistral. Mainly developed for internal development use you can use it too if your struggling with the same issue | |
| Note: Model was created with BFloat16 quantization | |
| --- | |
| license: apache-2.0 | |
| --- |