Update README.md
Browse files
README.md
CHANGED
@@ -1,175 +1,19 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
-
|
12 |
-
|
13 |
-
|
14 |
-
-
|
15 |
-
-
|
16 |
-
-
|
17 |
-
|
18 |
-
|
19 |
-
|
20 |
-
**Follow DeepBeepMeep on Twitter/X to get the Latest News**: https://x.com/deepbeepmeep
|
21 |
-
|
22 |
-
## 🔥 Latest Updates
|
23 |
-
### June 23 2025: WanGP v6.3, Vace Unleashed. Thought we couldnt squeeze Vace even more ?
|
24 |
-
- Multithreaded preprocessing when possible for faster generations
|
25 |
-
- Multithreaded frames Lanczos Upsampling as a bonus
|
26 |
-
- A new Vace preprocessor : *Flow* to extract fluid motion
|
27 |
-
- Multi Vace Controlnets: you can now transfer several properties at the same time. This opens new possibilities to explore, for instance if you transfer *Human Movement* and *Shapes* at the same time for some reasons the lighting of your character will take into account much more the environment of your character.
|
28 |
-
- Injected Frames Outpainting, in case you missed it in WanGP 6.21
|
29 |
-
|
30 |
-
Don't know how to use all of the Vace features ? Check the Vace Guide embedded in WanGP as it has also been updated.
|
31 |
-
|
32 |
-
|
33 |
-
### June 19 2025: WanGP v6.2, Vace even more Powercharged
|
34 |
-
👋 Have I told you that I am a big fan of Vace ? Here are more goodies to unleash its power:
|
35 |
-
- If you ever wanted to watch Star Wars in 4:3, just use the new *Outpainting* feature and it will add the missing bits of image at the top and the bottom of the screen. The best thing is *Outpainting* can be combined with all the other Vace modifications, for instance you can change the main character of your favorite movie at the same time
|
36 |
-
- More processing can combined at the same time (for instance the depth process can be applied outside the mask)
|
37 |
-
- Upgraded the depth extractor to Depth Anything 2 which is much more detailed
|
38 |
-
|
39 |
-
As a bonus, I have added two finetunes based on the Safe-Forcing technology (which requires only 4 steps to generate a video): Wan 2.1 text2video Self-Forcing and Vace Self-Forcing. I know there is Lora around but the quality of the Lora is worse (at least with Vace) compared to the full model. Don't hesitate to share your opinion about this on the discord server.
|
40 |
-
### June 17 2025: WanGP v6.1, Vace Powercharged
|
41 |
-
👋 Lots of improvements for Vace the Mother of all Models:
|
42 |
-
- masks can now be combined with on the fly processing of a control video, for instance you can extract the motion of a specific person defined by a mask
|
43 |
-
- on the fly modification of masks : reversed masks (with the same mask you can modify the background instead of the people covered by the masks), enlarged masks (you can cover more area if for instance the person you are trying to inject is larger than the one in the mask), ...
|
44 |
-
- view these modified masks directly inside WanGP during the video generation to check they are really as expected
|
45 |
-
- multiple frames injections: multiples frames can be injected at any location of the video
|
46 |
-
- expand past videos in on click: just select one generated video to expand it
|
47 |
-
|
48 |
-
Of course all these new stuff work on all Vace finetunes (including Vace Fusionix).
|
49 |
-
|
50 |
-
Thanks also to Reevoy24 for adding a Notfication sound at the end of a generation and for fixing the background color of the current generation summary.
|
51 |
-
|
52 |
-
### June 12 2025: WanGP v6.0
|
53 |
-
👋 *Finetune models*: You find the 20 models supported by WanGP not sufficient ? Too impatient to wait for the next release to get the support for a newly released model ? Your prayers have been answered: if a new model is compatible with a model architecture supported by WanGP, you can add by yourself the support for this model in WanGP by just creating a finetune model definition. You can then store this model in the cloud (for instance in Huggingface) and the very light finetune definition file can be easily shared with other users. WanGP will download automatically the finetuned model for them.
|
54 |
-
|
55 |
-
To celebrate the new finetunes support, here are a few finetune gifts (directly accessible from the model selection menu):
|
56 |
-
- *Fast Hunyuan Video* : generate model t2v in only 6 steps
|
57 |
-
- *Hunyuan Vido AccVideo* : generate model t2v in only 5 steps
|
58 |
-
- *Wan FusioniX*: it is a combo of AccVideo / CausVid ans other models and can generate high quality Wan videos in only 8 steps
|
59 |
-
|
60 |
-
One more thing...
|
61 |
-
|
62 |
-
The new finetune system can be used to combine complementaty models : what happens when you combine Fusionix Text2Video and Vace Control Net ?
|
63 |
-
|
64 |
-
You get **Vace FusioniX**: the Ultimate Vace Model, Fast (10 steps, no need for guidance) and with a much better quality Video than the original slower model (despite being the best Control Net out there). Here goes one more finetune...
|
65 |
-
|
66 |
-
Check the *Finetune Guide* to create finetune models definitions and share them on the WanGP discord server.
|
67 |
-
|
68 |
-
### June 11 2025: WanGP v5.5
|
69 |
-
👋 *Hunyuan Video Custom Audio*: it is similar to Hunyuan Video Avatar except there isn't any lower limit on the number of frames and you can use your reference images in a different context than the image itself\
|
70 |
-
*Hunyuan Video Custom Edit*: Hunyuan Video Controlnet, use it to do inpainting and replace a person in a video while still keeping his poses. Similar to Vace but less restricted than the Wan models in terms of content...
|
71 |
-
|
72 |
-
|
73 |
-
### June 6 2025: WanGP v5.41
|
74 |
-
👋 Bonus release: Support for **AccVideo** Lora to speed up x2 Video generations in Wan models. Check the Loras documentation to get the usage instructions of AccVideo.\
|
75 |
-
You will need to do a *pip install -r requirements.txt*
|
76 |
-
|
77 |
-
### June 6 2025: WanGP v5.4
|
78 |
-
👋 World Exclusive : **Hunyuan Video Avatar** Support ! You won't need 80 GB of VRAM nor 32 GB oF VRAM, just 10 GB of VRAM will be sufficient to generate up to 15s of high quality speech / song driven Video at a high speed with no quality degradation. Support for TeaCache included.\
|
79 |
-
Here is a link to the original repo where you will find some very interesting documentation and examples. https://github.com/Tencent-Hunyuan/HunyuanVideo-Avatar. Kudos to the Hunyuan Video Avatar team for the best model of its kind.\
|
80 |
-
Also many thanks to Reevoy24 for his repackaging / completing the documentation
|
81 |
-
|
82 |
-
### May 28 2025: WanGP v5.31
|
83 |
-
👋 Added **Phantom 14B**, a model that you can use to transfer objects / people in the video. My preference goes to Vace that remains the king of controlnets.
|
84 |
-
VACE improvements: Better sliding window transitions, image mask support in Matanyone, new Extend Video feature, and enhanced background removal options.
|
85 |
-
|
86 |
-
### May 26, 2025: WanGP v5.3
|
87 |
-
👋 Settings management revolution! Now you can:
|
88 |
-
- Select any generated video and click *Use Selected Video Settings* to instantly reuse its configuration
|
89 |
-
- Drag & drop videos to automatically extract their settings metadata
|
90 |
-
- Export/import settings as JSON files for easy sharing and backup
|
91 |
-
|
92 |
-
### May 20, 2025: WanGP v5.2
|
93 |
-
👋 **CausVid support** - Generate videos in just 4-12 steps with the new distilled Wan model! Also added experimental MoviiGen for 1080p generation (20GB+ VRAM required). Check the Loras documentation to get the usage instructions of CausVid.
|
94 |
-
|
95 |
-
### May 18, 2025: WanGP v5.1
|
96 |
-
👋 **LTX Video 13B Distilled** - Generate high-quality videos in less than one minute!
|
97 |
-
|
98 |
-
### May 17, 2025: WanGP v5.0
|
99 |
-
👋 **One App to Rule Them All!** Added Hunyuan Video and LTX Video support, plus Vace 14B and integrated prompt enhancer.
|
100 |
-
|
101 |
-
See full changelog: **[Changelog](docs/CHANGELOG.md)**
|
102 |
-
|
103 |
-
## 📋 Table of Contents
|
104 |
-
|
105 |
-
- [🚀 Quick Start](#-quick-start)
|
106 |
-
- [📦 Installation](#-installation)
|
107 |
-
- [🎯 Usage](#-usage)
|
108 |
-
- [📚 Documentation](#-documentation)
|
109 |
-
- [🔗 Related Projects](#-related-projects)
|
110 |
-
|
111 |
-
## 🚀 Quick Start
|
112 |
-
|
113 |
-
**One-click installation:** Get started instantly with [Pinokio App](https://pinokio.computer/)
|
114 |
-
|
115 |
-
**Manual installation:**
|
116 |
-
```bash
|
117 |
-
git clone https://github.com/deepbeepmeep/Wan2GP.git
|
118 |
-
cd Wan2GP
|
119 |
-
conda create -n wan2gp python=3.10.9
|
120 |
-
conda activate wan2gp
|
121 |
-
pip install torch==2.7.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/test/cu124
|
122 |
-
pip install -r requirements.txt
|
123 |
-
```
|
124 |
-
|
125 |
-
**Run the application:**
|
126 |
-
```bash
|
127 |
-
python wgp.py # Text-to-video (default)
|
128 |
-
python wgp.py --i2v # Image-to-video
|
129 |
-
```
|
130 |
-
|
131 |
-
**Update the application:**
|
132 |
-
If using Pinokio use Pinokio to update otherwise:
|
133 |
-
Get in the directory where WanGP is installed and:
|
134 |
-
```bash
|
135 |
-
git pull
|
136 |
-
pip install -r requirements.txt
|
137 |
-
```
|
138 |
-
|
139 |
-
## 📦 Installation
|
140 |
-
|
141 |
-
For detailed installation instructions for different GPU generations:
|
142 |
-
- **[Installation Guide](docs/INSTALLATION.md)** - Complete setup instructions for RTX 10XX to RTX 50XX
|
143 |
-
|
144 |
-
## 🎯 Usage
|
145 |
-
|
146 |
-
### Basic Usage
|
147 |
-
- **[Getting Started Guide](docs/GETTING_STARTED.md)** - First steps and basic usage
|
148 |
-
- **[Models Overview](docs/MODELS.md)** - Available models and their capabilities
|
149 |
-
|
150 |
-
### Advanced Features
|
151 |
-
- **[Loras Guide](docs/LORAS.md)** - Using and managing Loras for customization
|
152 |
-
- **[Finetunes](docs/FINETUNES.md)** - Add manually new models to WanGP
|
153 |
-
- **[VACE ControlNet](docs/VACE.md)** - Advanced video control and manipulation
|
154 |
-
- **[Command Line Reference](docs/CLI.md)** - All available command line options
|
155 |
-
|
156 |
-
## 📚 Documentation
|
157 |
-
|
158 |
-
- **[Changelog](docs/CHANGELOG.md)** - Latest updates and version history
|
159 |
-
- **[Troubleshooting](docs/TROUBLESHOOTING.md)** - Common issues and solutions
|
160 |
-
|
161 |
-
## 🔗 Related Projects
|
162 |
-
|
163 |
-
### Other Models for the GPU Poor
|
164 |
-
- **[HuanyuanVideoGP](https://github.com/deepbeepmeep/HunyuanVideoGP)** - One of the best open source Text to Video generators
|
165 |
-
- **[Hunyuan3D-2GP](https://github.com/deepbeepmeep/Hunyuan3D-2GP)** - Image to 3D and text to 3D tool
|
166 |
-
- **[FluxFillGP](https://github.com/deepbeepmeep/FluxFillGP)** - Inpainting/outpainting tools based on Flux
|
167 |
-
- **[Cosmos1GP](https://github.com/deepbeepmeep/Cosmos1GP)** - Text to world generator and image/video to world
|
168 |
-
- **[OminiControlGP](https://github.com/deepbeepmeep/OminiControlGP)** - Flux-derived application for object transfer
|
169 |
-
- **[YuE GP](https://github.com/deepbeepmeep/YuEGP)** - Song generator with instruments and singer's voice
|
170 |
-
|
171 |
-
---
|
172 |
-
|
173 |
-
<p align="center">
|
174 |
-
Made with ❤️ by DeepBeepMeep
|
175 |
-
</p>
|
|
|
1 |
+
---
|
2 |
+
title: WanGP v6.3 - Hunyuan Video Avatar Suite
|
3 |
+
emoji: 🎭
|
4 |
+
colorFrom: purple
|
5 |
+
colorTo: pink
|
6 |
+
sdk: gradio
|
7 |
+
sdk_version: 4.44.0
|
8 |
+
app_file: app.py
|
9 |
+
pinned: false
|
10 |
+
license: mit
|
11 |
+
hardware: a10g-large
|
12 |
+
short_description: Complete AI Video Avatar Generation Suite
|
13 |
+
tags:
|
14 |
+
- video-generation
|
15 |
+
- avatar
|
16 |
+
- hunyuan
|
17 |
+
- wan
|
18 |
+
- audio-driven
|
19 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|