glyd/Qwen3.5-27B-swift

Qwen3.5-27B · Glyd swift

18.6 GB, 65% smaller than bf16 (53.8 GB). Glyd's swift level of Qwen/Qwen3.5-27B (commit fc05daec): about 5.5 bits per weight, quantized once from the original bf16 weights. Not lossless: KL divergence from bf16 is 0.0173 (lower is closer).

curl -LsSf https://getglyd.com/install.sh | sh
glyd run Qwen/Qwen3.5-27B:swift

Compared

	Size	Smaller than bf16	KL vs bf16	RTX 4090
bf16 (original)	53.8 GB	–	0	–
Qwen FP8	29.5 GB	45%	–	–
kestrel	22.0 GB	59%	0.00789	40 tok/s
swift (this repo)	18.6 GB	65%	0.0173	46 tok/s

Size: the files you download. KL: how far the model's next-token probabilities move from bf16, measured on WikiText-2.

Speed and memory

GPU	Tokens/s	First token	Memory at 4k	32k context
RTX 4090	46	482 ms	20.8 GB	yes
L40S	36	428 ms	20.9 GB	yes
RTX A6000	34	725 ms	20.7 GB	yes

Measured 2026-10-09 with glyd 0.29.4: one GPU each, a 4k-token context; memory is the GPU memory in use.

Fits a 32k context on: RTX 4090, L40S, RTX A6000.

Good to know

• Runs on Glyd's engine (glyd run): Linux with an NVIDIA GPU, driver 580 or newer. Not for vLLM or transformers yet.
• Text only: the model's vision part is not included.
• The Hub's "8-bit precision" and "Model size" labels count packed bytes: this checkpoint is about 5.5 bits per weight, from a model with 26,895,998,464 parameters.

License

Weights: Apache-2.0, from Qwen/Qwen3.5-27B. Glyd's engine, which runs them: BUSL-1.1, free for personal and non-commercial use on your own computers; commercial use needs a license. getglyd.com