SenseLLM/StructureCoder-3B

Alignment with Fill-In-the-Middle for Enhancing Code Generation

📄 Paper • 🏠 Repo • 🤖 Models

Introduction

Structure splits code snippets into smaller, granular blocks, creatingmore diverse DPO pairs from the same testcases. Additionally, we introduce the Abstract Syntax Tree (AST) splitting and curriculum training method to enhance the DPO training. Please refer to our paper for more details!

---

Models

Model	Checkpoint	Size
StructureCoder-1.5B	🤗 HF Link	1.5B
StructureCoder-3B	🤗 HF Link	3B
StructureCoder-7B	🤗 HF Link	7B

Acknowledgments

We thank the following amazing projects that truly inspired us:

• Qwen-Coder
• APPS
• EvalPlus
• LiveCodeBench
• BigCodeBench