limcheekin's picture
feat: updated from F16 to Q8_0 to fix slow loading
ec314a6
|
raw
history blame
393 Bytes
metadata
title: replit-code-v1_5-3b-GGUF (Q8_0)
colorFrom: purple
colorTo: blue
sdk: docker
models:
  - replit/replit-code-v1_5-3b
  - abetlen/replit-code-v1_5-3b-GGUF
tags:
  - inference api
  - openai-api compatible
  - llama-cpp-python
  - replit-code-v1_5-3b-GGUF
  - gguf
pinned: false

replit-code-v1_5-3b-GGUF (Q8_0)

Please refer to the index.html for more information.