A 7B LVLM with 128K context window and 512K generalization through long-context continued pre-training
Zhaowei Wang
ZhaoweiWang
AI & ML interests
NLP
Recent Activity
commentedon a paper 4 days ago
Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K ContextOrganizations
datasets 9
ZhaoweiWang/MMLongBench
Preview • Updated • 711 • 5
ZhaoweiWang/image_full_collection
Viewer • Updated • 3.4k • 19
ZhaoweiWang/image_collection
Preview • Updated • 5.96k
ZhaoweiWang/DivScene-DivTraj
Viewer • Updated • 117k • 24
ZhaoweiWang/AbsPyramid
Preview • Updated • 24 • 3
ZhaoweiWang/Levy_Holt_dataset_jsonl
Viewer • Updated • 23.9k • 61
ZhaoweiWang/AbstractATOMIC
Viewer • Updated • 92.2k • 7 • 1
ZhaoweiWang/COPES
Preview • Updated • 6 • 1
ZhaoweiWang/SubeventWriter
Preview • Updated • 1 • 1