PnLCalib / sn_calibration /ChallengeRules.md
2nzi's picture
Upload 63 files
3d1f2c9
# Guidelines for the Calibration challenge
The 2nd [Calibration challenge]() will be held at the
official [CVSports Workshop](https://vap.aau.dk/cvsports/) at CVPR 2023!
Subscribe (watch) the repo to receive the latest info regarding timeline and prizes!
We provide an [evaluation server](https://eval.ai/web/challenges/challenge-page/1946/overview) for anyone competing in the challenge.
This evaluation server handles predictions for the open **test** set and the segregated **challenge** set.
Winners will be announced at CVSports Workshop at CVPR 2022.
Prizes πŸ’²πŸ’²πŸ’² include $1000 cash award, sponsored by [EVS Broadcast Equipment](https://evs.com/).
## Who can participate / How to participate?
- Any individual can participate to the challenge, except the organizers.
- The participants are recommended to form a team to participate.
- Each team can have one or more members.
- An individual/team can compete on both task.
- An individual associated with multiple teams (for a given task) or a team with multiple accounts will be disqualified.
- On both task, a particpant can only use the images as input.
- A particpant is allowed to extract its own visual/audio features with any pre-trained model.
## How to win / What is the prize?
- For each task, the winner is the individual/team who reach the highest performance on the **challenge** set.
- The metrics taken into consideration is the combined metric: completeness * Accuracy@5.
- The deadline to submit your results is May 30th at 11.59 pm Pacific Time.
- The teams that perform best will be granted $1000 from our sponsor [EVS Broadcast Equipment](https://evs.com/).
- In order to be eligible for the prize, we require the individual/team to provide a short report describing the details of the methodology (CVPR format, max 2 pages)
## Important dates
Note that these dates are tentative and subject to changes if necessary.
- **February 1:** Open evaluation server on the (Open) Test set.
- **February 15:** Open evaluation server on the (Seggregated) Challenge set.
- **May 30:** Close evaluation server.
- **June 6:** Deadline for submitting the report.
- **June 19:** A full-day workshop at CVPR 2023.
For any further doubt or concern, please raise an issue in that repository, or contact us directly on [Discord](https://discord.gg/SM8uHj9mkP).