Update README.md
Browse files
README.md
CHANGED
@@ -10,13 +10,99 @@ tags:
|
|
10 |
- stateful-ai
|
11 |
- prompt-engineering
|
12 |
- found-protocol
|
|
|
|
|
|
|
13 |
base_model:
|
14 |
- google/gemini-pro-vision
|
15 |
- google/gemini-pro
|
16 |
datasets:
|
17 |
-
- FOUND-
|
18 |
---
|
19 |
|
20 |
-
|
21 |
-
|
22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
- stateful-ai
|
11 |
- prompt-engineering
|
12 |
- found-protocol
|
13 |
+
- creator-economy
|
14 |
+
- data-sovereignty
|
15 |
+
- web3
|
16 |
base_model:
|
17 |
- google/gemini-pro-vision
|
18 |
- google/gemini-pro
|
19 |
datasets:
|
20 |
+
- FOUND-LABS/found_consciousness_log
|
21 |
---
|
22 |
|
23 |
+
<div align="center">
|
24 |
+
<img src="https://res.cloudinary.com/dykojggih/image/upload/v1753377308/IMG_4287_imd6zd.png" width="100px" alt="FOUND LABS Logo">
|
25 |
+
<h1>The FOUND Protocol</h1>
|
26 |
+
<p><b>The Open-Source Engine for the Consciousness Economy</b></p>
|
27 |
+
|
28 |
+
<div>
|
29 |
+
<a href="https://huggingface.co/FOUND-LABS"><img src="https://img.shields.io/badge/Organization-FOUND%20LABS-purple" alt="Organization"></a>
|
30 |
+
<a href="https://huggingface.co/FOUND-LABS/found_consciousness_log"><img src="https://img.shields.io/badge/Dataset-Consciousness%20Log-blue" alt="Dataset"></a>
|
31 |
+
<a href="https://foundprotocol.xyz"><img src="https://img.shields.io/badge/Platform-Join%20Waitlist-brightgreen" alt="Join Waitlist"></a>
|
32 |
+
</div>
|
33 |
+
</div>
|
34 |
+
|
35 |
+
---
|
36 |
+
|
37 |
+
## Abstract
|
38 |
+
|
39 |
+
Current video understanding models excel at semantic labeling but fail to capture the pragmatic and thematic progression of visual narratives. We introduce **FOUND (Forensic Observer and Unified Narrative Deducer)**, a novel, stateful architecture that demonstrates the ability to extract coherent emotional and thematic arcs from a sequence of disparate video inputs. This protocol serves as the foundational engine for the **[FOUND Platform](https://foundprotocol.xyz)**, a decentralized creator economy where individuals can own, control, and monetize their authentic human experiences as valuable AI training data.
|
40 |
+
|
41 |
+
---
|
42 |
+
|
43 |
+
## From Open-Source Research to a New Economy
|
44 |
+
|
45 |
+
The FOUND Protocol is more than an academic exercise; it is the core technology powering a new paradigm for the creator economy.
|
46 |
+
|
47 |
+
- **The Problem:** AI companies harvest your data to train their models, reaping all the rewards. You, the creator of the data, get nothing.
|
48 |
+
- **Our Solution:** The FOUND Protocol transforms your raw visual moments into structured, high-value data assets. Our upcoming **FOUND Platform** will allow you to contribute this data, maintain ownership via your own wallet, and earn from its usage by AI companies.
|
49 |
+
|
50 |
+
**This open-source model is the proof. The FOUND Platform is the promise.**
|
51 |
+
|
52 |
+
---
|
53 |
+
|
54 |
+
## Model Architecture
|
55 |
+
|
56 |
+
The FOUND Protocol is a composite **inference pipeline** designed to simulate a stateful consciousness. It comprises two specialized agents that interact in a continuous feedback loop:
|
57 |
+
|
58 |
+
- **The Perceptor (`/dev/eye`):** A forensic analysis model (FOUND-1) responsible for transpiling raw visual data into a structured, symbolic JSON output.
|
59 |
+
- **The Interpreter (`/dev/mind`):** A contextual state model (FOUND-2) that operates on the structured output of the Perceptor and the historical system log to resolve "errors" into emotional or thematic concepts.
|
60 |
+
- **The Narrative State Manager:** A stateful object that maintains the "long-term memory" of the system, allowing its interpretations to evolve.
|
61 |
+
|
62 |
+
---
|
63 |
+
|
64 |
+
## How to Use This Pipeline
|
65 |
+
|
66 |
+
### 1. Setup
|
67 |
+
|
68 |
+
Clone this repository and install the required dependencies into a Python virtual environment.
|
69 |
+
```bash
|
70 |
+
git clone https://huggingface.co/FOUND-LABS/found_protocol
|
71 |
+
cd found_protocol
|
72 |
+
python3 -m venv venv
|
73 |
+
source venv/bin/activate
|
74 |
+
pip install -r requirements.txt
|
75 |
+
```
|
76 |
+
|
77 |
+
### 2. Configuration
|
78 |
+
Set your Google Gemini API key as an environment variable (e.g., in a .env file):
|
79 |
+
```
|
80 |
+
GEMINI_API_KEY="your-api-key-goes-here"
|
81 |
+
```
|
82 |
+
|
83 |
+
### 3. Usage via CLI
|
84 |
+
Analyze all videos in a directory sequentially:
|
85 |
+
```bash
|
86 |
+
python main.py path/to/your/video_directory/
|
87 |
+
```
|
88 |
+
|
89 |
+
## Future Development: The Path to the Platform
|
90 |
+
This open-source protocol is the first step in our public roadmap. The data it generates is the key to our future.
|
91 |
+
- **Dataset Growth:** We are using this protocol to build the found_consciousness_log, the world's first open dataset for thematic video understanding.
|
92 |
+
- **Model Sovereignty:** This dataset will be used to fine-tune our own open-source models (found-perceptor-v1 and found-interpreter-v1), removing the dependency on external APIs and creating a fully community-owned intelligence layer.
|
93 |
+
- **Platform Launch:** These sovereign models will become the core engine of the FOUND Platform, allowing for decentralized, low-cost data processing at scale.
|
94 |
+
|
95 |
+
➡️ Follow our journey and join the waitlist at foundprotocol.xyz
|
96 |
+
|
97 |
+
## Citing this Work
|
98 |
+
If you use the FOUND Protocol in your research, please use the following BibTeX entry.
|
99 |
+
```bibtex
|
100 |
+
@misc{found_protocol_2025,
|
101 |
+
author = {FOUND LABS Community},
|
102 |
+
title = {FOUND Protocol: A Symbiotic Dual-Agent Architecture for the Consciousness Economy},
|
103 |
+
year = {2025},
|
104 |
+
publisher = {Hugging Face},
|
105 |
+
journal = {Hugging Face repository},
|
106 |
+
howpublished = {\url{https://huggingface.co/FOUND-LABS/found_protocol}}
|
107 |
+
}
|
108 |
+
```
|