fwtan/llama-1.1b-mobilequant-w4a8-s1024-e60-hf
1B
•
Updated
•
5
Fuwen Tan
fwtan
AI & ML interests
None yet
Recent Activity
new activity
about 1 month ago
fwtan/llama-1.1b-mobilequant-w4a8-s1024-e60-hf:Adding `safetensors` variant of this model
upvoted
a
paper
12 months ago
MobileQuant: Mobile-friendly Quantization for On-device Language Models
new activity
over 1 year ago
princeton-nlp/Sheared-LLaMA-1.3B-ShareGPT:updating n_kv_heads in config.json
Organizations
fwtan/who_where_wacv2018_data
Updated
fwtan/text2scene_cvpr2019_ckpts
Updated
fwtan/rrt_sop_data
Updated
fwtan/sslight_checkpoints
Updated
fwtan/anyprec-MobileLLaMA-1.4B-Chat-dns-3.65-4.06-w4_orig2-gc1-c4_s100_blk512_v2
Updated
•
5
fwtan/anyprec-MobileLLaMA-1.4B-Chat-dns-3.65-4.06-w4_orig2-gc1-c4_s100_blk512
Updated
•
5
fwtan/dns_new_ckpts
Updated
fwtan/dns_ckpts
Updated
fwtan/phi-3_5_converted
4B
•
Updated
•
3
fwtan/stablelm-2-1.6b_converted
2B
•
Updated
•
5
fwtan/stablelm-2-1_6b-mobilequant-w8a8-s1024-e60-hf
Updated
•
4
fwtan/stablelm-2-1_6b-mobilequant-w4a8-s1024-e60-sym-hf
Updated
•
5
fwtan/stablelm-2-1_6b-mobilequant-w4a8-s1024-e60-hf
Updated
•
4
fwtan/gemma-2b-mobilequant-w8a8-s1024-e60-hf
Updated
•
5
fwtan/llm_8gen3_demo
Updated
fwtan/llama-1.1b-mobilequant-w8a8-s1024-e60-8gen3
Updated
fwtan/llama-1.1b-mobilequant-w4a8-s1024-e60-sym-8gen3
Updated
fwtan/llama-1.1b-mobilequant-w8a8-s1024-e60-hf
Updated
•
5
fwtan/llama-1.1b-mobilequant-w4a8-s1024-e60-sym-hf
Updated
•
6
fwtan/gemma-2b-mobilequant-w4a8-s1024-e60-sym-hf
Updated
•
5
fwtan/gemma-2b-mobilequant-w4a8-s1024-e60-hf
Updated
•
5
fwtan/llama-1.1b-converted
1B
•
Updated
•
7
fwtan/gemma-2b-converted
3B
•
Updated
•
5
fwtan/sheared-llama-1-3b-sharegpt-q4f16-0-MLC
Updated
fwtan/sheared-llama-1-3b-sharegpt-q4f16-1-MLC
Updated
fwtan/moe_test
Text Generation
•
6B
•
Updated
•
6