litert-community
/

Qwen2-0.5B-Instruct

Text Generation

Model card Files Files and versions

Qwen2-0.5B-Instruct LiteRT-LM Model

This repository contains LiteRT-LM variants of Qwen/Qwen2-0.5B-Instruct optimized for on-device text generation.

Available Artifact

File	Quantization Recipe	Context	Size
`Qwen2_0.5B_Instruct.litertlm`	dynamic_wi8_afp32	-	647.4 MB

Integration

Ready to integrate this into your product? Get started in the LiteRT-LM documentation.

Downloads last month: 190

Model tree for litert-community/Qwen2-0.5B-Instruct

Base model

Qwen/Qwen2-0.5B

Finetuned

Qwen/Qwen2-0.5B-Instruct

Quantized

(90)

this model

Collection including litert-community/Qwen2-0.5B-Instruct

GenAI

Generative AI on device: LLMs, VLMs, audio-LMs (speech LMs), embeddings, and text-to-image — LiteRT / LiteRT-LM ready. • 76 items • Updated 7 days ago • 2