John Johnson

jjokah

AI & ML interests

Natural Language Processing

Recent Activity

liked a model 16 days ago
microsoft/Phi-4-multimodal-instruct
liked a model 26 days ago
microsoft/bitnet-b1.58-2B-4T
upvoted a paper about 1 month ago
A Survey of Small Language Models
View all activity

Organizations

Blog-explorers's profile picture Magnisale's profile picture Cohere Labs Community's profile picture Hugging Face Discord Community's profile picture

Posts 4

view post
Post
2347
# Video Tokenization โ€” for efficient AI video processing

Meet ๐•๐ข๐๐“๐จ๐ค, a new open-source video tokenization technique developed by Microsoft Research to address the computational challenges of processing large volumes of video data. The core problem VidTok tackles is the inefficiency caused by redundant information in raw video pixels.

VidTok converts complex video footage into compact, structured units called tokens, making it easier and more efficient for AI systems to analyze, understand, and generate video content.

Research Paper: https://arxiv.org/abs/2412.13061
VidTok Code: https://github.com/microsoft/VidTok

Articles 1

Article
26

Small Language Models (SLM): A Comprehensive Overview

models 0

None public yet

datasets 0

None public yet