David Euler

davideuler's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mlx-community/gemma-2-27b-it-4bit 8 months ago

The model only generates <pad> token

1

#2 opened about 1 year ago by

Hyeongdon

New activity in YorkieOH10/granite-34b-code-instruct-Q8_0-GGUF over 1 year ago

Failed to load model

3

#1 opened over 1 year ago by

davideuler

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw over 1 year ago

Can this version be loaded with vllm?

2

#1 opened over 1 year ago by

wawoshashi

New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw over 1 year ago

Could you help to create the 3.25bpw model so it can fits on A100?

4

#1 opened over 1 year ago by

davideuler

New activity in turboderp/Mixtral-8x7B-instruct-exl2 over 1 year ago

bpw and corresponding vram usage

👍 10

18

#1 opened over 1 year ago by

joujiboi

New activity in alpindale/c4ai-command-r-plus-GPTQ over 1 year ago

How to load command r+ in text-generation-webui?

5

#1 opened over 1 year ago by

MLDataScientist

New activity in stabilityai/stable-code-3b over 1 year ago

How could I run inference with the gguf models?

6

#6 opened over 1 year ago by

davideuler

New activity in saltlux/luxia-21.4b-alignment-v1.0 over 1 year ago

Quantized GGUF available

👀 👍 4

3

#3 opened over 1 year ago by

MaziyarPanahi

New activity in brittlewis12/gorilla-openfunctions-v2-GGUF over 1 year ago

I wonder how did you create the GGUF model?

2

#1 opened over 1 year ago by

davideuler

New activity in stabilityai/stable-code-3b over 1 year ago

How could I run inference with the gguf models?

6

#6 opened over 1 year ago by

davideuler