limcheekin's picture
feat: updated from F16 to Q8_0 to fix slow loading
ec314a6
|
raw
history blame
393 Bytes
---
title: replit-code-v1_5-3b-GGUF (Q8_0)
colorFrom: purple
colorTo: blue
sdk: docker
models:
- replit/replit-code-v1_5-3b
- abetlen/replit-code-v1_5-3b-GGUF
tags:
- inference api
- openai-api compatible
- llama-cpp-python
- replit-code-v1_5-3b-GGUF
- gguf
pinned: false
---
# replit-code-v1_5-3b-GGUF (Q8_0)
Please refer to the [index.html](index.html) for more information.