Abdu07 commited on
Commit
589ea79
·
verified ·
1 Parent(s): 505cfe7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -18
README.md CHANGED
@@ -1,37 +1,64 @@
1
- ---
2
- datasets:
3
- - Hemg/AI-Generated-vs-Real-Images-Datasets
4
- metrics:
5
- - accuracy
6
- base_model:
7
- - microsoft/resnet-50
8
- pipeline_tag: image-classification
9
- tags:
10
- - art
11
- ---
12
 
13
  # Multi-Task Image Classifier
14
 
15
-
16
  ## Model Overview
17
  This model is a **Multi-Task Image Classifier** that performs two tasks simultaneously:
18
  1. **Object Recognition:** Identifies the primary object in an image (e.g., "cat," "dog," "car," etc.).
19
  2. **Authenticity Classification:** Determines whether the image is AI-generated or a real photograph.
20
 
21
- The model uses a ResNet-50 backbone with two heads: one for multi-class object recognition (trained on pseudo-labels generated by a Vision Transformer) and another for binary classification (AI-generated vs. Real). It was trained on a subset of the [Hemg/AI-Generated-vs-Real-Images-Datasets](https://huggingface.co/datasets/Hemg/AI-Generated-vs-Real-Images-Datasets).
22
 
23
  ## Intended Use
24
  This model is designed for:
25
- - **Digital Content Verification:** Detecting AI-generated images to prevent misinformation.
26
  - **Social Media Moderation:** Automatically flagging images that are likely AI-generated.
27
- - **Content Analysis:** Helping researchers understand the prevalence of AI art versus real images.
28
 
29
  ## How to Use
30
- You can use this model locally or via a Hugging Face Space. For local usage, load the state dictionary into the model architecture using PyTorch. For example:
31
  ```python
32
  import torch
33
- from model import MultiTaskModel # your model definition
34
 
 
35
  model = MultiTaskModel(...)
 
 
36
  model.load_state_dict(torch.load("multitask_model_weights.pth", map_location="cpu"))
37
- model.eval()
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
 
2
  # Multi-Task Image Classifier
3
 
 
4
  ## Model Overview
5
  This model is a **Multi-Task Image Classifier** that performs two tasks simultaneously:
6
  1. **Object Recognition:** Identifies the primary object in an image (e.g., "cat," "dog," "car," etc.).
7
  2. **Authenticity Classification:** Determines whether the image is AI-generated or a real photograph.
8
 
9
+ The model uses a **ResNet-50** backbone with two heads: one for multi-class object recognition (trained on pseudo-labels generated by a Vision Transformer) and another for binary classification (AI-generated vs. Real). It was trained on a subset of the [Hemg/AI-Generated-vs-Real-Images-Datasets](https://huggingface.co/datasets/Hemg/AI-Generated-vs-Real-Images-Datasets).
10
 
11
  ## Intended Use
12
  This model is designed for:
13
+ - **Digital Content Verification:** Detecting AI-generated images to help prevent misinformation.
14
  - **Social Media Moderation:** Automatically flagging images that are likely AI-generated.
15
+ - **Content Analysis:** Assisting researchers in understanding the prevalence of AI art versus real images in digital media.
16
 
17
  ## How to Use
18
+ You can use this model locally or via the provided Hugging Face Space. For local usage, load the state dictionary into the model architecture using PyTorch. For example:
19
  ```python
20
  import torch
21
+ from model import MultiTaskModel # Your model definition
22
 
23
+ # Instantiate your model architecture (must match training)
24
  model = MultiTaskModel(...)
25
+
26
+ # Load the saved state dictionary (trained weights)
27
  model.load_state_dict(torch.load("multitask_model_weights.pth", map_location="cpu"))
28
+ model.eval()
29
+ ```
30
+ Alternatively, you can test the model directly via our interactive demo:
31
+ [Test the Model Here](https://huggingface.co/spaces/Abdu07/multitask-demo)
32
+
33
+ ## Training Data and Evaluation
34
+ - **Dataset:** The model was trained on a subset of the [Hemg/AI-Generated-vs-Real-Images-Datasets](https://huggingface.co/datasets/Hemg/AI-Generated-vs-Real-Images-Datasets) comprising approximately 152k images.
35
+ - **Metrics:**
36
+ - **Authenticity (AI vs. Real):** Validation accuracy reached around 85% after early epochs.
37
+ - **Object Recognition:** Pseudo-label accuracy started at around 38–40% and improved during training.
38
+ - **Evaluation:** Detailed evaluation metrics and loss curves are available in our training logs.
39
+
40
+ ## Model Details
41
+ - **Trained by:** [Abdellahi El Moustapha](https://abmstpha.github.io/)
42
+ - **Language:** Not applicable (image model)
43
+ - **Base Model:** ResNet-50
44
+ - **Datasets:** Hemg/AI-Generated-vs-Real-Images-Datasets
45
+ - **Library:** PyTorch
46
+ - **Pipeline Tag:** image-classification
47
+ - **Metrics:** Accuracy for both binary classification and multi-class object recognition
48
+ - **Version:** v1.0
49
+
50
+ ## Limitations and Ethical Considerations
51
+ - **Pseudo-Labeling:** The object recognition task uses pseudo-labels generated from a pretrained model, which may introduce noise or bias.
52
+ - **Authenticity Sensitivity:** The binary classifier may face challenges with highly realistic AI-generated images.
53
+ - **Usage:** This model is intended for research and prototyping purposes. Additional validation is recommended before deploying in high-stakes applications.
54
+
55
+ ## How to Cite
56
+ If you use this model, please cite:
57
+ ```bibtex
58
+ @misc{multitask_classifier,
59
+ title={Multi-Task Image Classifier},
60
+ author={Abdellahi El Moustapha},
61
+ year={2025},
62
+ howpublished={\url{https://huggingface.co/Abdu07/multitask-model}}
63
+ }
64
+ ```