Hugging Face's logo

Spaces:
Amarthya7
/
Multi-Modal-Medical-Analysis-System
Running

App Files Community
Multi-Modal-Medical-Analysis-System / README.md
Amarthya7's picture
Amarthya7
Upload 6 files
9a01245 verified
preview code
|
raw
history blame
2.55 kB

MediSync: Multi-Modal Medical Analysis System

Open In HF Spaces

Overview

MediSync is an AI-powered healthcare solution that combines X-ray image analysis with patient report text processing to provide comprehensive medical insights. This demo showcases how multiple AI models can work together to provide a more complete analysis than either could alone.

Features

  • X-ray Image Analysis: Detects abnormalities in chest X-rays using pre-trained vision models
  • Medical Report Processing: Extracts key information from patient reports using NLP models
  • Multi-modal Integration: Combines insights from both image and text data for more accurate diagnosis suggestions
  • Image Enhancement: Provides image enhancement options for better visualization

How to Use This Space

  1. Upload an X-ray Image: Click on the upload field to add your chest X-ray image
  2. Enter Medical Report Text: Type or paste the corresponding radiologist's report
  3. Choose Analysis Type:
    • Multimodal Analysis: Combines both image and text data
    • Image Analysis: Focuses only on the X-ray image
    • Text Analysis: Extracts key information from the medical report

Models Used

  • X-ray Analysis: facebook/deit-base-patch16-224-medical-cxr
  • Medical Text Analysis: medicalai/ClinicalBERT
  • Additional Support Models: Medical entity recognition models

Example Inputs

The app comes with example inputs you can use to test its functionality:

  • Sample chest X-rays with varying conditions
  • Example medical reports with different findings

Important Disclaimer

This system is designed as a support tool and should NOT replace professional medical diagnosis. It is intended for educational and research purposes only. Always consult with healthcare professionals for medical decisions.

Technical Details

MediSync is built with:

  • Gradio for the user interface
  • PyTorch and Transformers for the model backends
  • Advanced visualization utilities for result interpretation

Citation & Credits

If you use MediSync in your research, please cite:

@software{MediSync2023,
  author = {MediSync Team},
  title = {MediSync: Multi-Modal Medical Analysis System},
  year = {2023},
  url = {https://huggingface.co/spaces/MediSync}
}

License

This project is released under the MIT License.