Spaces:
Running
Running
File size: 2,048 Bytes
dd3979d 93c4f75 dd3979d 93c4f75 dd3979d 93c4f75 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 |
---
title: BrailleMenuGen
emoji: 🦀
colorFrom: green
colorTo: green
sdk: gradio
sdk_version: 5.29.0
app_file: app.py
pinned: false
---
# Menu to Braille Converter
An AI-powered application that converts food menu images to Braille text for visually impaired users.
## Features
- Upload menu images
- Extract text using AI-powered document understanding (LayoutLMv2)
- Process and structure menu text using LLMs
- Convert text to Braille
- Display Braille in multiple formats (text, visual, side-by-side)
- Download as PDF in different formats
## Deployment on Hugging Face Spaces
### Option 1: Direct GitHub Repository Deployment
1. Fork this repository to your GitHub account
2. Go to [Hugging Face Spaces](https://huggingface.co/spaces)
3. Click "Create new Space"
4. Choose "Streamlit" as the SDK
5. Connect your GitHub account and select this repository
6. Choose hardware requirements (recommend at least GPU for better performance)
7. Click "Create Space"
### Option 2: Manual Deployment
1. Go to [Hugging Face Spaces](https://huggingface.co/spaces)
2. Click "Create new Space"
3. Choose "Streamlit" as the SDK
4. Give your Space a name
5. Choose hardware requirements (recommend at least GPU for better performance)
6. Click "Create Space"
7. Clone the Space repository locally
8. Copy all files from this project to the cloned repository
9. Push the changes to the Space repository
## Hardware Requirements
- **Minimum**: CPU (2 vCPUs, 16 GB RAM)
- **Recommended**: GPU (T4 or better)
## Models Used
- **Document AI**: microsoft/layoutlmv2-base-uncased
- **Text Processing**: meta-llama/Meta-Llama-3-8B-Instruct (with fallback to mistralai/Mistral-7B-Instruct-v0.2)
- **Context Enhancement**: facebook/bart-large-cnn
## Local Development
1. Clone this repository
2. Install dependencies: `pip install -r requirements.txt`
3. Run the application: `streamlit run app.py`
## Future Enhancements
- Improved menu section recognition
- Support for multiple languages
- Physical Braille printer integration
- Mobile app version |