Video-Text-to-Text
Transformers
Safetensors
English
llava
text-generation
multimodal
Eval Results (legacy)
Instructions to use lmms-lab/LLaVA-Video-7B-Qwen2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lmms-lab/LLaVA-Video-7B-Qwen2 with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForCausalLM processor = AutoProcessor.from_pretrained("lmms-lab/LLaVA-Video-7B-Qwen2") model = AutoModelForCausalLM.from_pretrained("lmms-lab/LLaVA-Video-7B-Qwen2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
size mismatch for vision_model
#10
by XiaoHangjia - opened
same problem
same problem.How to solve it???Please.
It works. Thank you!!!
However,There are some warnings:
UserWarning: for vision_model.head.mlp.fc2.bias: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass assign=True to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?)
Have you encountered it?

