add benchmark results on Khadas VIM4 (#223)
Browse files- benchmark/README.md +56 -4
- benchmark/color_table.svg +0 -0
- benchmark/table_config.yaml +4 -0
benchmark/README.md
CHANGED
@@ -753,16 +753,68 @@ mean median min input size model
|
|
753 |
1169.59 1415.29 774.09 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2022oct_int8.onnx']
|
754 |
```
|
755 |
|
756 |
-
<!--
|
757 |
-
|
758 |
### Khadas VIM4
|
759 |
|
760 |
-
|
|
|
|
|
|
|
|
|
|
|
761 |
|
|
|
|
|
762 |
```
|
763 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
764 |
```
|
765 |
|
|
|
|
|
766 |
### NVIDIA Jetson Orin Nano
|
767 |
|
768 |
CPU:
|
|
|
753 |
1169.59 1415.29 774.09 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2022oct_int8.onnx']
|
754 |
```
|
755 |
|
|
|
|
|
756 |
### Khadas VIM4
|
757 |
|
758 |
+
Board specs: https://www.khadas.com/vim4, https://dl.khadas.com/products/vim4/specs/vim4-specs.pdf
|
759 |
+
|
760 |
+
SoC specs:
|
761 |
+
- CPU: Amlogic A311D2, 2.2GHz Quad core ARM Cortex-A73 and 2.0GHz Quad core Cortex-A53 CPU, with 32-bit STM32G031K6 microprocessor.
|
762 |
+
- GPU: Mali G52MP8(8EE) 800Mhz GPU.
|
763 |
+
- NPU: 3.2 TOPS Build-in NPU (Not supported by dnn yet)
|
764 |
|
765 |
+
CPU:
|
766 |
+
<!-- config wechat is excluded due to it needs building with opencv_contrib -->
|
767 |
```
|
768 |
+
$ python3 benchmark.py --all --cfg_exclude wechat
|
769 |
+
Benchmarking ...
|
770 |
+
backend=cv.dnn.DNN_BACKEND_OPENCV
|
771 |
+
target=cv.dnn.DNN_TARGET_CPU
|
772 |
+
mean median min input size model
|
773 |
+
4.27 4.33 4.17 [160, 120] YuNet with ['face_detection_yunet_2023mar.onnx']
|
774 |
+
4.58 4.58 4.17 [160, 120] YuNet with ['face_detection_yunet_2023mar_int8.onnx']
|
775 |
+
39.94 39.98 39.42 [150, 150] SFace with ['face_recognition_sface_2021dec.onnx']
|
776 |
+
49.33 50.59 39.42 [150, 150] SFace with ['face_recognition_sface_2021dec_int8.onnx']
|
777 |
+
17.28 17.63 16.93 [112, 112] FacialExpressionRecog with ['facial_expression_recognition_mobilefacenet_2022july.onnx']
|
778 |
+
22.78 23.27 16.93 [112, 112] FacialExpressionRecog with ['facial_expression_recognition_mobilefacenet_2022july_int8.onnx']
|
779 |
+
25.83 25.46 25.30 [224, 224] MPHandPose with ['handpose_estimation_mediapipe_2023feb.onnx']
|
780 |
+
28.23 28.87 25.30 [224, 224] MPHandPose with ['handpose_estimation_mediapipe_2023feb_int8.onnx']
|
781 |
+
47.68 47.72 45.65 [192, 192] PPHumanSeg with ['human_segmentation_pphumanseg_2023mar.onnx']
|
782 |
+
49.25 49.45 45.65 [192, 192] PPHumanSeg with ['human_segmentation_pphumanseg_2023mar_int8.onnx']
|
783 |
+
38.73 38.18 37.89 [224, 224] MobileNet with ['image_classification_mobilenetv1_2022apr.onnx']
|
784 |
+
33.68 33.99 29.16 [224, 224] MobileNet with ['image_classification_mobilenetv2_2022apr.onnx']
|
785 |
+
36.22 29.50 29.16 [224, 224] MobileNet with ['image_classification_mobilenetv1_2022apr_int8.onnx']
|
786 |
+
36.12 35.69 29.16 [224, 224] MobileNet with ['image_classification_mobilenetv2_2022apr_int8.onnx']
|
787 |
+
219.81 220.21 215.97 [224, 224] PPResNet with ['image_classification_ppresnet50_2022jan.onnx']
|
788 |
+
224.03 222.27 215.97 [224, 224] PPResNet with ['image_classification_ppresnet50_2022jan_int8.onnx']
|
789 |
+
81.46 84.07 77.95 [320, 240] LPD_YuNet with ['license_plate_detection_lpd_yunet_2023mar.onnx']
|
790 |
+
81.46 83.07 77.95 [320, 240] LPD_YuNet with ['license_plate_detection_lpd_yunet_2023mar_int8.onnx']
|
791 |
+
136.14 136.12 128.61 [416, 416] NanoDet with ['object_detection_nanodet_2022nov.onnx']
|
792 |
+
136.57 136.30 128.61 [416, 416] NanoDet with ['object_detection_nanodet_2022nov_int8.onnx']
|
793 |
+
805.54 805.23 795.82 [640, 640] YoloX with ['object_detection_yolox_2022nov.onnx']
|
794 |
+
768.87 766.00 727.12 [640, 640] YoloX with ['object_detection_yolox_2022nov_int8.onnx']
|
795 |
+
29.47 29.39 28.49 [1280, 720] VitTrack with ['object_tracking_vittrack_2023sep.onnx']
|
796 |
+
54.45 54.76 53.45 [192, 192] MPPalmDet with ['palm_detection_mediapipe_2023feb.onnx']
|
797 |
+
60.84 61.07 53.45 [192, 192] MPPalmDet with ['palm_detection_mediapipe_2023feb_int8.onnx']
|
798 |
+
57.22 57.22 56.14 [224, 224] MPPersonDet with ['person_detection_mediapipe_2023mar.onnx']
|
799 |
+
218.22 224.50 215.54 [128, 256] YoutuReID with ['person_reid_youtu_2021nov.onnx']
|
800 |
+
199.53 203.24 179.85 [128, 256] YoutuReID with ['person_reid_youtu_2021nov_int8.onnx']
|
801 |
+
53.06 54.61 51.82 [256, 256] MPPose with ['pose_estimation_mediapipe_2023mar.onnx']
|
802 |
+
148.82 149.62 146.73 [640, 480] PPOCRDet with ['text_detection_cn_ppocrv3_2023may.onnx']
|
803 |
+
148.91 148.99 146.59 [640, 480] PPOCRDet with ['text_detection_en_ppocrv3_2023may.onnx']
|
804 |
+
175.33 150.60 146.59 [640, 480] PPOCRDet with ['text_detection_cn_ppocrv3_2023may_int8.onnx']
|
805 |
+
194.12 201.48 146.59 [640, 480] PPOCRDet with ['text_detection_en_ppocrv3_2023may_int8.onnx']
|
806 |
+
133.27 132.90 132.54 [1280, 720] CRNN with ['text_recognition_CRNN_CH_2021sep.onnx']
|
807 |
+
135.27 135.12 132.54 [1280, 720] CRNN with ['text_recognition_CRNN_CN_2021nov.onnx']
|
808 |
+
127.49 137.43 113.82 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2021sep.onnx']
|
809 |
+
129.18 125.95 113.82 [1280, 720] CRNN with ['text_recognition_CRNN_CH_2023feb_fp16.onnx']
|
810 |
+
125.82 114.44 113.82 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2023feb_fp16.onnx']
|
811 |
+
127.63 124.81 113.82 [1280, 720] CRNN with ['text_recognition_CRNN_CH_2022oct_int8.onnx']
|
812 |
+
129.24 134.50 113.82 [1280, 720] CRNN with ['text_recognition_CRNN_CN_2021nov_int8.onnx']
|
813 |
+
126.64 125.09 110.45 [1280, 720] CRNN with ['text_recognition_CRNN_EN_2022oct_int8.onnx']
|
814 |
```
|
815 |
|
816 |
+
<!--
|
817 |
+
|
818 |
### NVIDIA Jetson Orin Nano
|
819 |
|
820 |
CPU:
|
benchmark/color_table.svg
CHANGED
|
|
benchmark/table_config.yaml
CHANGED
@@ -202,6 +202,10 @@ Devices:
|
|
202 |
display_info: "Khadas VIM3\nA311D\nCPU"
|
203 |
platform: "CPU"
|
204 |
|
|
|
|
|
|
|
|
|
205 |
- name: "Atlas 200 DK"
|
206 |
display_info: "Atlas 200 DK\nAscend 310\nCPU"
|
207 |
platform: "CPU"
|
|
|
202 |
display_info: "Khadas VIM3\nA311D\nCPU"
|
203 |
platform: "CPU"
|
204 |
|
205 |
+
- name: "Khadas VIM4"
|
206 |
+
display_info: "Khadas VIM4\nA311D2\nCPU"
|
207 |
+
platform: "CPU"
|
208 |
+
|
209 |
- name: "Atlas 200 DK"
|
210 |
display_info: "Atlas 200 DK\nAscend 310\nCPU"
|
211 |
platform: "CPU"
|