Object Detection
ultralytics
Eval Results
πŸ‡ͺπŸ‡Ί Region: EU
hellcaster commited on
Commit
3d73652
Β·
verified Β·
1 Parent(s): 200c66d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +140 -3
README.md CHANGED
@@ -1,3 +1,140 @@
1
- ---
2
- license: agpl-3.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Ultralytics/YOLO11
4
+ pipeline_tag: object-detection
5
+ library_name: ultralytics
6
+ metrics:
7
+ - mAP50
8
+ - mAP50-95
9
+ - accuracy50
10
+ - precision
11
+ - recall
12
+ - f1
13
+ model-index:
14
+ - name: MacPaw/yolov11l-ui-elements-detection
15
+ results:
16
+ - task:
17
+ type: object-detection
18
+ metrics:
19
+ - type: accuracy
20
+ value: 0.65359
21
22
+ - task:
23
+ type: object-detection
24
+ metrics:
25
+ - type: precision
26
+ value: 0.49055
27
+ name: precision
28
+ - task:
29
+ type: object-detection
30
+ metrics:
31
+ - type: recall
32
+ value: 0.43433
33
+ name: recall
34
+ - task:
35
+ type: object-detection
36
+ metrics:
37
+ - type: f1
38
+ value: 0.43776
39
+ name: f1
40
+ - task:
41
+ type: object-detection
42
+ metrics:
43
+ - type: map
44
+ value: 0.46644
45
46
+ - task:
47
+ type: object-detection
48
+ metrics:
49
+ - type: map
50
+ value: 0.31295
51
52
+ datasets:
53
+ - MacPaw/Screen2AX-Element
54
+ license: agpl-3.0
55
+ ---
56
+
57
+ # πŸ” YOLOv11l β€” UI Elements Detection
58
+
59
+ This model is a fine-tuned version of [`Ultralytics/YOLO11`](https://huggingface.co/Ultralytics/YOLO11), trained to detect **UI elements** in macOS application screenshots.
60
+
61
+ It is part of the **Screen2AX** project β€” a research effort focused on generating accessibility metadata using computer vision.
62
+
63
+ ---
64
+
65
+ ## 🧠 Task Overview
66
+
67
+ - **Task:** Object Detection
68
+ - **Target:** Individual UI elements
69
+ - **Supported Labels:**
70
+ ```
71
+ ['AXButton', 'AXDisclosureTriangle', 'AXImage', 'AXLink', 'AXTextArea']
72
+ ```
73
+
74
+ This model detects common interactive components typically surfaced in accessibility trees on macOS.
75
+
76
+ ---
77
+
78
+ ## πŸ—‚ Dataset
79
+
80
+ - Training data: [`MacPaw/Screen2AX-Element`](https://huggingface.co/datasets/MacPaw/Screen2AX-Element)
81
+
82
+ ---
83
+
84
+ ## πŸš€ How to Use
85
+
86
+ ### πŸ”§ Install Dependencies
87
+
88
+ ```bash
89
+ pip install huggingface_hub ultralytics
90
+ ```
91
+
92
+ ### πŸ§ͺ Load the Model and Run Predictions
93
+
94
+ ```python
95
+ from huggingface_hub import hf_hub_download
96
+ from ultralytics import YOLO
97
+
98
+ # Download the model
99
+ model_path = hf_hub_download(
100
+ repo_id="MacPaw/yolov11l-ui-elements-detection",
101
+ filename="ui-elements-detection.pt",
102
+ )
103
+
104
+ # Load and run prediction
105
+ model = YOLO(model_path)
106
+ results = model.predict("/path/to/your/image")
107
+
108
+ # Display result
109
+ results[0].show()
110
+ ```
111
+
112
+ ---
113
+
114
+ ## πŸ“œ License
115
+
116
+ This model is licensed under the **GNU Affero General Public License v3.0 (AGPL-3.0)**, as inherited from the original YOLOv11 base model.
117
+
118
+ ---
119
+
120
+ ## πŸ”— Related Projects
121
+
122
+ - [Screen2AX Project](https://github.com/MacPaw/Screen2AX)
123
+ - [Screen2AX HuggingFace Collection](https://huggingface.co/collections/MacPaw/screen2ax-687dfe564d50f163020378b8)
124
+ - [YOLOv11l β€” UI Groups Detection](https://huggingface.co/MacPaw/yolov11l-ui-groups-detection)
125
+
126
+ ---
127
+
128
+ ## ✍️ Citation
129
+
130
+ If you use this model in your research, please cite the Screen2AX paper:
131
+
132
+ ```bibtex
133
+ ...
134
+ ```
135
+
136
+ ---
137
+
138
+ ## 🌐 MacPaw Research
139
+
140
+ Learn more at [https://research.macpaw.com](https://research.macpaw.com)