Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
microsoft
/
Phi-4-multimodal-instruct
like
1.38k
Follow
Microsoft
12.3k
Automatic Speech Recognition
Transformers
Safetensors
24 languages
phi4mm
text-generation
nlp
code
audio
speech-summarization
speech-translation
visual-question-answering
phi-4-multimodal
phi
phi-4-mini
custom_code
arxiv:
2503.01743
arxiv:
2407.13833
License:
mit
Model card
Files
Files and versions
Community
74
Train
Use this model
main
Phi-4-multimodal-instruct
Ctrl+K
Ctrl+K
13 contributors
History:
33 commits
nguyenbh
Update readme
33e62ac
verified
12 days ago
examples
Add examples
3 months ago
figures
Added model files
3 months ago
speech-lora
Added model files
3 months ago
vision-lora
Added model files
3 months ago
.gitattributes
Safe
1.61 kB
added technical report
3 months ago
CODE_OF_CONDUCT.md
Safe
444 Bytes
Added model files
3 months ago
LICENSE
Safe
1.14 kB
Added model files
3 months ago
README.md
65.3 kB
Update readme
12 days ago
SECURITY.md
Safe
2.66 kB
Added model files
3 months ago
SUPPORT.md
Safe
1.24 kB
Added model files
3 months ago
added_tokens.json
Safe
249 Bytes
Added model files
3 months ago
config.json
Safe
4.63 kB
Added model files
3 months ago
configuration_phi4mm.py
Safe
11 kB
Added model files
3 months ago
generation_config.json
Safe
190 Bytes
Added model files
3 months ago
merges.txt
Safe
2.42 MB
Added model files
3 months ago
model-00001-of-00003.safetensors
Safe
5 GB
LFS
Added model files
3 months ago
model-00002-of-00003.safetensors
Safe
4.95 GB
LFS
Added model files
3 months ago
model-00003-of-00003.safetensors
Safe
1.2 GB
LFS
Added model files
3 months ago
model.safetensors.index.json
Safe
240 kB
Added model files
3 months ago
modeling_phi4mm.py
Safe
116 kB
fixes the asserion error when num_beams > 1 (#42)
2 months ago
phi_4_mm.tech_report.02252025.pdf
Safe
5.3 MB
LFS
added technical report
3 months ago
preprocessor_config.json
Safe
482 Bytes
Added model files
3 months ago
processing_phi4mm.py
Safe
32.8 kB
Added model files
3 months ago
processor_config.json
Safe
121 Bytes
Revert PR 56 (#65)
about 1 month ago
sample_finetune_speech.py
Safe
16.7 kB
Fix bug with safe suffix removal (#34)
2 months ago
sample_finetune_vision.py
Safe
19.6 kB
Added model files
3 months ago
sample_inference_phi4mm.py
Safe
10.5 kB
Added model files
3 months ago
special_tokens_map.json
Safe
473 Bytes
Added model files
3 months ago
speech_conformer_encoder.py
Safe
111 kB
Support this model device-independent. (#52)
about 2 months ago
tokenizer.json
Safe
15.5 MB
LFS
Revert PR 56 (#65)
about 1 month ago
tokenizer_config.json
Safe
3.25 kB
Revert PR 56 (#65)
about 1 month ago
vision_siglip_navit.py
Safe
78.2 kB
Added model files
3 months ago
vocab.json
Safe
3.91 MB
Revert PR 56 (#65)
about 1 month ago
