Improve model card, add metadata and links

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +33 -1
README.md CHANGED
@@ -1 +1,33 @@
1
- Model weight of [MBD-LMs](https://arxiv.org/abs/2606.29215)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ ---
6
+
7
+ # Multi-Block Diffusion Language Models (MBD-LMs)
8
+
9
+ Model weight of [MBD-LMs](https://arxiv.org/abs/2606.29215)
10
+
11
+ - **Project Page:** [https://sjtu-deng-lab.github.io/mbd-lms](https://sjtu-deng-lab.github.io/mbd-lms)
12
+ - **GitHub Repository:** [https://github.com/SJTU-DENG-Lab/mbd-lms](https://github.com/SJTU-DENG-Lab/mbd-lms)
13
+
14
+ ## Introduction
15
+
16
+ Block Diffusion Language Models (BD-LMs) improve diffusion-based text generation with KV caching and flexible-length generation. Multi-Block Diffusion Language Models (MBD-LMs) extend this paradigm from Single-Block Diffusion (SingleBD) to Multi-Block Diffusion (MultiBD), where a running-set of consecutive blocks is decoded concurrently for inter-block parallelism.
17
+
18
+ This is achieved via:
19
+ - **Multi-block Teacher Forcing (MultiTF):** A training strategy that integrates teacher forcing and diffusion forcing by training on bounded noise-groups conditioned on clean prefixes.
20
+ - **Block Buffer Inference Mechanism:** An optimized decoding algorithm that preserves prefix-cache reuse and keeps tensor shapes static for accelerated, CUDA Graph-friendly execution.
21
+
22
+ For detailed guidelines on training, evaluation, and benchmark execution, please refer to the official [GitHub repository](https://github.com/SJTU-DENG-Lab/mbd-lms).
23
+
24
+ ## Citation
25
+
26
+ ```bibtex
27
+ @article{jin2026multiblock,
28
+ title={Multi-Block Diffusion Language Models},
29
+ author={Yijie Jin and Jiajun Xu and Yuxuan Liu and Chenkai Xu and Yi Tu and Jiajun Li and Dandan Tu and Xiaohui Yan and Kai Yu and Pengfei Liu and Zhijie Deng},
30
+ journal={arXiv preprint arXiv:2606.29215},
31
+ year={2026}
32
+ }
33
+ ```