Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
pytorch 's Collections
TorchAO Quantized Phi-4-mini-instruct

TorchAO Quantized Phi-4-mini-instruct

updated about 3 hours ago

TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch

Upvote
2

  • pytorch/Phi-4-mini-instruct-int4wo-hqq

    Text Generation • Updated 1 day ago • 1.14k

  • pytorch/Phi-4-mini-instruct-float8dq

    Text Generation • Updated 1 day ago • 984

  • pytorch/Phi-4-mini-instruct-8da4w

    Text Generation • Updated about 8 hours ago • 765 • 1
Upvote
2
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs