metadata
license: apache-2.0
pipeline_tag: text-generation
tags:
- code
Currently Ctranslate2 does not directly support mistral and zephyr models for conversion
Here is a custom converted model made possible by some code changes to the ct2 repo for mistral. Mainly developed for internal development use you can use it too if your struggling with the same issue
Note: Model was created with BFloat16 quantization