README.md

---
title: AI Embedded Knowledge Agent
emoji: 🧠
colorFrom: indigo
colorTo: purple
sdk: gradio
sdk_version: "5.33.0"
app_file: app.py
pinned: false
---



# 🧠 AI Embedded Knowledge Agent (Payman)

A comprehensive Retrieval-Augmented Generation (RAG) system that allows you to upload documents, process URLs, and ask intelligent questions about your knowledge base. Built with modern AI technologies and optimized for deployment on Hugging Face Spaces.

## 🎥 Demo Video

Watch our comprehensive demo showcasing the live search capabilities and RAG system in action:

[![RAG AI Demo](https://img.shields.io/badge/🎥_Watch_Demo-Loom-00D4AA?style=for-the-badge)](https://www.loom.com/share/f1a3c79b75ad4b65b528b2973612cdd9?sid=a0932972-2926-42ab-a031-3149e40b1b97)

_See how the system processes documents, performs live web searches, and generates intelligent responses with real-time data integration._

## ✨ Features

### 🔥 Core Capabilities

- **📄 Document Processing**: Support for PDF, DOCX, CSV, XLSX, PPTX, TXT, MD, and more
- **🌐 URL Processing**: Extract content from web pages with intelligent crawling
- **🔍 Live Web Search**: Real-time web search using Tavily API for up-to-date information
- **🧠 Smart Q&A**: Ask questions and get contextual answers with source attribution
- **🎯 High Accuracy**: Advanced embedding and similarity search for precise results
- **⚡ Real-time Processing**: Fast document ingestion and query processing

### 🚀 Advanced Features

- **🤖 Multiple LLM Support**: Gemini 2.5 Flash, OpenAI GPT models with automatic fallback
- **📊 Analytics Dashboard**: Query analytics, system metrics, and performance monitoring
- **🔍 Smart Query Processing**: Query expansion, caching, and suggestion system
- **📚 Knowledge Base Management**: View, manage, and export your knowledge base
- **🛡️ Robust Error Handling**: Graceful degradation and comprehensive error recovery
- **🎨 Beautiful UI**: Modern Gradio interface optimized for user experience

### 🏗️ Technical Excellence

- **🔧 Modular Architecture**: Clean, maintainable, and extensible codebase
- **⚙️ Configurable**: Comprehensive YAML configuration for all components
- **🔒 Secure**: Input sanitization, rate limiting, and security best practices
- **📈 Scalable**: Designed for production deployment with monitoring and health checks
- **🧪 Well-tested**: Comprehensive test suite and example usage

## 🎯 Project Origin & Agentic Vision

This project was initially conceived and developed as part of the **`payman`**, showcasing a robust **`paymanai`** for intelligent knowledge retrieval and generation. Our vision was to build an autonomous AI agent capable of:

- **🧠 Intelligent Information Retrieval**: Acting as a smart agent to fetch, process, and synthesize information from diverse sources (documents, URLs, live web).
- **🚀 Dynamic Query Routing**: Intelligently deciding between local knowledge base retrieval and real-time web search based on query intent.
- **💡 Autonomous Knowledge Management**: Providing a self-contained system for building and querying a dynamic knowledge base.

This system embodies the principles of agentic AI, offering a powerful, self-sufficient solution for complex information needs.