Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
danielhanchen 
posted an update 18 days ago

any improvements that can be done the cheapest A100?

Saw PrismML's Bonsai 27B 1-bit/ternary release. Curious about their core training/quantization methods vs Unsloth’s Dynamic Quant 2.0. Do you think Unsloth can reach similar uniform 1-bit/ternary performance?

It's interesting to see optimization moving beyond model architecture and into deployment efficiency. Lowering the hardware requirements while improving throughput expands where these models can realistically be deployed. Over time, I suspect infrastructure efficiency will become one of the primary differentiators.