30 5 53

Chris Scott

chriswritescode

https://chriswritescode.dev

chriswritescode-dev

AI & ML interests

None yet

Recent Activity

new activity 4 days ago

openai/gpt-oss-120b:Request: 4-bit GPTQ or AWQ quantized version of openai/gpt-oss-20b

new activity 5 days ago

openai/gpt-oss-120b:VLLM - Flash-attn 3

liked a model 5 days ago

KittenML/kitten-tts-nano-0.1

View all activity

Organizations

None yet

New activity in openai/gpt-oss-120b 4 days ago

Request: 4-bit GPTQ or AWQ quantized version of openai/gpt-oss-20b

❤️ 🚀 9

#32 opened 5 days ago by

powtac

New activity in openai/gpt-oss-120b 5 days ago

VLLM - Flash-attn 3

#23 opened 5 days ago by

chriswritescode

New activity in cpatonn/GLM-4.5-Air-AWQ-4bit 12 days ago

Please make one for the larger Non Air Variant

#2 opened 12 days ago by

chriswritescode

New activity in zai-org/GLM-4.5 13 days ago

AWQ 4Bit / GPTQ with full precision gates and head? Please

#4 opened 13 days ago by

chriswritescode

New activity in chriswritescode/Qwen3-235B-A22B-Instruct-2507-AWQ-Swift 14 days ago

Qwen3-235B-A22B-Instruct-2507, int4-w4a16 or awq? Which one has better accuracy recovery?

#1 opened 15 days ago by

traphix

New activity in chriswritescode/Qwen3-235B-A22B-Instruct-2507-INT4-W4A16 17 days ago

Type of quantization

#1 opened 20 days ago by

systemicAnomaly

New activity in koushd/Qwen3-235B-A22B-Instruct-2507-AWQ 17 days ago

Quantization Config

#2 opened 17 days ago by

chriswritescode

New activity in NVFP4/Qwen3-235B-A22B-Instruct-2507-FP4 17 days ago

quantization method?

#2 opened 17 days ago by

chriswritescode

New activity in LGAI-EXAONE/EXAONE-4.0-32B-FP8 27 days ago

VLLM

#1 opened 27 days ago by

chriswritescode

New activity in baidu/ERNIE-4.5-300B-A47B-PT about 1 month ago

Tool support? Multiple tool calls?

#1 opened about 1 month ago by

chriswritescode

New activity in tencent/Hunyuan-A13B-Instruct-FP8 about 1 month ago

Fast tokenizer, general VLLM support

#5 opened about 1 month ago by

chriswritescode

New activity in tencent/Hunyuan-A13B-Instruct about 1 month ago

Tool calling parser?

#11 opened about 1 month ago by

sguo35

New activity in tencent/Hunyuan-A13B-Instruct-FP8 about 1 month ago

VLLM docker deployment

#4 opened about 1 month ago by

chriswritescode

New activity in tomaarsen/Qwen3-Reranker-0.6B-seq-cls about 2 months ago

other models

#1 opened about 2 months ago by

scotto2

New activity in rednote-hilab/dots.llm1.inst 2 months ago

Yarn context

#3 opened 2 months ago by

chriswritescode

New activity in Ithanil/Llama-3_1-Nemotron-Ultra-253B-v1-W8A8-Dynamic 3 months ago

Quantization question

#1 opened 3 months ago by

cruzanstx

New activity in Qwen/Qwen3-235B-A22B-GPTQ-Int4 3 months ago

I get errors trying to deploy this in vllm or sglang.

😔 👍 7

#1 opened 3 months ago by

chriswritescode

New activity in QuixiAI/Qwen3-235B-A22B-AWQ 3 months ago

VLLM, SGLANG

#1 opened 3 months ago by

chriswritescode

New activity in fastllm/Qwen3-235B-A22B-INT4MIX 3 months ago

How was this made? Quant configuration? Have you deployed this with SGLANG or vllm ?

#1 opened 3 months ago by

chriswritescode

New activity in justinjja/Qwen3-235B-A22B-INT4-W4A16 3 months ago

Slow inference on vLLM

#1 opened 3 months ago by

hp1337

Chris Scott

AI & ML interests

Recent Activity

Organizations

chriswritescode's activity

Request: 4-bit GPTQ or AWQ quantized version of openai/gpt-oss-20b

VLLM - Flash-attn 3

Please make one for the larger Non Air Variant

AWQ 4Bit / GPTQ with full precision gates and head? Please

Qwen3-235B-A22B-Instruct-2507, int4-w4a16 or awq? Which one has better accuracy recovery?

Type of quantization

Quantization Config

quantization method?

VLLM

Tool support? Multiple tool calls?

Fast tokenizer, general VLLM support

Tool calling parser?

VLLM docker deployment

other models

Yarn context

Quantization question

I get errors trying to deploy this in vllm or sglang.

VLLM, SGLANG

How was this made? Quant configuration? Have you deployed this with SGLANG or vllm ?

Slow inference on vLLM