ghostai1 commited on
Commit
3454211
·
verified ·
1 Parent(s): dd4cd4c

Update GhostPackDemo/readme.md

Browse files
Files changed (1) hide show
  1. GhostPackDemo/readme.md +84 -21
GhostPackDemo/readme.md CHANGED
@@ -1,9 +1,9 @@
1
- # 👻🎬 GhostPackDemo · Apache 2.0
2
 
3
  Generate cinematic **30 FPS** AI videos from a single image—runs locally on your GPU.
4
 
5
- [![Python](https://img.shields.io/badge/python-3.8%2B-blue?logo=python)](https://python.org)
6
- [![License](https://img.shields.io/badge/license-Apache%202.0-green)](LICENSE)
7
  [![HF Space](https://img.shields.io/badge/🤗%20Spaces-Live%20Demo-orange)](https://huggingface.co/spaces/ghostai1/GhostPackDemo)
8
 
9
  ---
@@ -11,37 +11,100 @@ Generate cinematic **30 FPS** AI videos from a single image—runs locally on yo
11
  ## ⚡ Showcase
12
 
13
  <p align="center">
14
- <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/k8pgUlg4OvdUZpbMNTcp5.gif"
15
- alt="GhostPackDemo animated example" style="max-width:100%;height:auto;">
16
  </p>
17
 
18
  <p align="center">
19
- <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/7ABE2lOA4LOUtPfh1mhxP.png" width="30%" alt="Main UI">
20
- <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/9qNVRX2eM2iCY8xQKcOwW.png" width="30%" alt="Progress Preview">
21
- <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/--fIS9ITg4-VqN22ySoa2.png" width="30%" alt="Finished Video">
22
  </p>
23
 
24
  ---
25
 
26
  ## 1 · Overview
27
- GhostPackDemo bundles **HunyuanVideo** + **FramePack** into a single-script GPU pipeline (`ghostpack.py`) with an intuitive **Gradio** UI.
28
- Upload any starter image, enter a prompt, and receive a 30 FPS MP4 clip with live denoising preview.
29
 
30
  ---
31
 
32
- ## 2 · Feature Matrix
 
 
 
 
 
 
33
 
34
- | ✅ Feature | Description |
35
- |---------------------------|--------------------------------------------------------------------------------|
36
- | Image Video diffusion | Full diffusion loop conditioned on image **and** text |
37
- | Live progress & preview | Real-time denoise frames + progress bar |
38
- | VRAM-aware execution | Automatic slicing/offload when free VRAM &lt; 60 GB |
39
- | Offline HF cache | Models cached once in `hf_download/` |
40
- | One-click installer | `install.py` builds venv, installs deps, logs in to HF, downloads models |
41
- | Cross-platform | Linux 🐧 · WSL · Windows 🪟 (PowerShell) |
42
- | Permissive license | Distributed under **Apache 2.0**—commercial & non-commercial use allowed |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
 
44
  ---
45
 
46
- ## 3 · Architecture
 
47
 
 
 
 
1
+ # 👻🎬 GhostPackDemo · Apache-2.0
2
 
3
  Generate cinematic **30 FPS** AI videos from a single image—runs locally on your GPU.
4
 
5
+ [![Python](https://img.shields.io/badge/python-3.8%2B-blue?logo=python)](https://python.org)
6
+ [![License](https://img.shields.io/badge/license-Apache%202.0-green)](LICENSE)
7
  [![HF Space](https://img.shields.io/badge/🤗%20Spaces-Live%20Demo-orange)](https://huggingface.co/spaces/ghostai1/GhostPackDemo)
8
 
9
  ---
 
11
  ## ⚡ Showcase
12
 
13
  <p align="center">
14
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/k8pgUlg4OvdUZpbMNTcp5.gif" alt="GhostPack demo GIF" style="max-width:100%; height:auto;">
 
15
  </p>
16
 
17
  <p align="center">
18
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/7ABE2lOA4LOUtPfh1mhxP.png" width="32%" alt="Main UI">
19
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/9qNVRX2eM2iCY8xQKcOwW.png" width="32%" alt="Progress Preview">
20
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/--fIS9ITg4-VqN22ySoa2.png" width="32%" alt="Finished Video">
21
  </p>
22
 
23
  ---
24
 
25
  ## 1 · Overview
26
+ GhostPackDemo bundles **HunyuanVideo** + **FramePack** into a single-script GPU pipeline (`ghostpack_main_fixed.py`) with a **Gradio** UI. Unleash photorealistic videos with ≥6GB VRAM GPUs, optimized for 8GB RAM laptops.
 
27
 
28
  ---
29
 
30
+ ## 2 · Features
31
+ - **Veo 3-Level AI**: Hyper-realistic video with next-frame prediction, smooth transitions.
32
+ - **Phantom Speed**: Teacache cuts rendering time ~40% (~12-15s/frame on RTX 3060).
33
+ - **Laptop Domination**: Supports 13B models on ≥6GB VRAM GPUs (e.g., RTX 3060).
34
+ - **Custom Workflows**: Adjustable frame length, batch size, prompts.
35
+ - **Live Preview**: Real-time frame previews in ghostgradio.py.
36
+ - **Open Source**: Community-driven enhancements under Apache 2.0.
37
 
38
+ ---
39
+
40
+ ## 3 · Optimizations
41
+ - **Speed**: Teacache (~40% faster, \( T_{\text{total}} \approx 0.6 \cdot T_{\text{base}} \)), Sage-Attention (~5-10% faster, \( T_{\text{attn}} \approx 0.9 \cdot T_{\text{base_attn}} \)), CUDA Tweaks (~10-15% latency reduction, \( L_{\text{CUDA}} \approx 0.85 \cdot L_{\text{base}} \)), Dynamic Scheduling (~15-20% task time, \( T_{\text{sched}} \approx 0.8 \cdot T_{\text{base_sched}} \)).
42
+ - **Memory**: Context Packing (~50% VRAM save, \( M_{\text{VRAM}} \propto O(1) \)), tcmalloc (~5-20% overhead, \( O_{\text{mem}} \approx 0.8 \cdot O_{\text{glibc}} \)), Memory Cache (~25% fewer swaps, \( M_{\text{swap}} \approx 0.75 \cdot M_{\text{base_swap}} \)).
43
+ - **Compute**: Dynamic Batching (~30-50% throughput, \( \text{Throughput} \propto B \cdot \text{FPS}_{\text{base}} \)).
44
+ - **Efficiency**: Power Optimization (~20-30% power save, \( P_{\text{idle}} \approx 0.7 \cdot P_{\text{base_idle}} \)), Thread Tuning (~10-15% CPU boost, \( C_{\text{thread}} \approx 0.85 \cdot C_{\text{base_thread}} \)).
45
+ - **VRAM Requirements**: GTX 1650 (6GB, ~18-25s/frame), RTX 3050 (8GB, ~15-20s/frame), RTX 3060 (12GB, ~10-15s/frame), RTX 4090 (24GB, ~1.5-2.5s/frame).
46
+
47
+ ---
48
+
49
+ ## 4 · Demo
50
+ Witness GhostPack’s spectral video generation with a neon-lit spectral battle scene sample. [More Demos](https://github.com/ghostai1/GhostPack/blob/main/demo_videos).
51
+
52
+ ---
53
+
54
+ ## 5 · Future
55
+ - **Voice Generation**: AI-driven voice synthesis for narrated videos.
56
+ - **AI Images**: High-quality starting frames with AI visuals.
57
+ - **VR Integration**: Future VR video rendering support.
58
+
59
+ ---
60
+
61
+ ## 6 · Installation
62
+ Requires >30GB disk, compatible hardware. Ubuntu: bash git clone https://github.com/ghostai1/GhostPack cd GhostPack chmod +x install_ubuntu.sh ./install_ubuntu.sh (NVIDIA GPU, 8GB RAM, Python 3.10, CUDA 12.6) Windows: bash git clone https://github.com/ghostai1/GhostPack cd GhostPack install.bat (Auto-downloads >30GB models, needs NVIDIA drivers) macOS: bash git clone https://github.com/ghostai1/GhostPack cd GhostPack chmod +x install_macos.sh ./install_macos.sh (M1/M2 support, slower with Metal) Latest Release: [Link](https://github.com/ghostai1/GhostPack/releases).
63
+
64
+ ---
65
+
66
+ ## 7 · Usage
67
+ Launch GUI: bash source ~/ghostpack_venv/venv/bin/activate cd ~/ghostpack_venv python ghostgradio.py --port 5666 --server 0.0.0.0 Craft Spells: Upload image, prompt “A spectral figure glides through a neon-lit city,” enable teacache, set 15fps, 5s video. Summon Spirits: Monitor with nvidia-smi (~80-100% GPU usage). Export Results: Save MP4 with CRF 0-100.
68
+
69
+ ---
70
+
71
+ ## 8 · Community
72
+ Discord: [Join Now](https://discord.gg/ghostpack) for support. X: [Visit X](https://x.com/search?q=ghostpack) for news. Report Issues: [Link](https://github.com/ghostai1/GhostPack/issues).
73
+
74
+ ---
75
+
76
+ ## 9 · Technical Deep Dive
77
+ Architecture: Built on HunyuanVideo and FramePackI2V_HY with LlamaModel and CLIPTextModel. Pipeline: k-diffusion with unipc for high-quality frame generation. Wiki: [Link](https://github.com/ghostai1/GhostPack/wiki).
78
+
79
+ ---
80
+
81
+ ## 10 · FAQ
82
+ Hardware: Minimum 6GB VRAM (GTX 1650), 8GB RAM; Optimal 12GB VRAM (RTX 3060). Install: Clone and run appropriate install script (e.g., ./install_ubuntu.sh). Contribute: Yes, see Contributing Guidelines.
83
+
84
+ ---
85
+
86
+ ## 11 · Tutorials
87
+ Getting Started: [View](https://github.com/ghostai1/GhostPack/wiki/Getting-Started). Advanced Configuration: [View](https://github.com/ghostai1/GhostPack/wiki/Advanced-Configuration). Video Export Tips: [View](https://github.com/ghostai1/GhostPack/wiki/Video-Export-Tips). More Tutorials: [Link](https://github.com/ghostai1/GhostPack/wiki/Tutorials).
88
+
89
+ ---
90
+
91
+ ## 12 · Contribute
92
+ Fork repo, create branch, submit PRs, follow wiki standards, test with ghostgradio.py. Guidelines: [Link](https://github.com/ghostai1/GhostPack/blob/main/CONTRIBUTING.md).
93
+
94
+ ---
95
+
96
+ ## 13 · Screenshots
97
+ Main Interface: [View](https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/7ABE2lOA4LOUtPfh1mhxP.png). Advanced Settings: [View](https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/9qNVRX2eM2iCY8xQKcOwW.png). Logs Display: [View](https://cdn-uploads.huggingface.co/production/uploads/6421b1c68adc8881b974a89d/--fIS9ITg4-VqN22ySoa2.png). Add your own to showcase projects!
98
+
99
+ ---
100
+
101
+ ## 14 · Latest Files
102
+ Latest File: [ghostgradio.py](https://github.com/ghostai1/GhostPack/blob/main/ghostgradio.py). Logs: [View](https://github.com/ghostai1/GhostPack/tree/main/outputs). Refresh Repo: [Link](https://github.com/ghostai1/GhostPack) | Refresh Logs: [Link](https://github.com/ghostai1/GhostPack/tree/main/outputs).
103
 
104
  ---
105
 
106
+ ## 15 · License
107
+ Distributed under Apache 2.0. See [LICENSE](LICENSE) for details.
108
 
109
+ 👻 GhostPack by ghostai1 | [GitHub](https://github.com/ghostai1/GhostPack) | [Hugging Face](https://huggingface.co/spaces/ghostai1/GhostPack)
110
+ Created 07:18 PM CDT, June 11, 2025 😈⚡️