Skip to content

Help: Wizard ‐ Challenge ‐ Protocol

Isabelle Guyon edited this page Aug 25, 2017 · 7 revisions

In this page, all you have to do is to choose the dates of your challenge.
This version of Chalab imposes a structure of challenge in two phases:

  1. Development phase [PROVIDE THE START DATE]: Participants can submit results or code to practice. The leaderboard will show only their performances on the validation set. Their last submission of that phase will be forwarded automatically to the next phase. They should make sure that their last submission is a code submission.
  2. Final phase [PROVIDE THE START DATE]: The start date of this phase is the end date of the previous phase. The "final phase" is a blind testing of the participants' last submission from the development phase on new "final" test data. No need to make a new submission.
Give plenty of time for the development phase (typically 40 days). The final phase should not last longer than the time it takes to run the code of the participants (typically 24 hours), but it has no end date, for convenience. This version of Chalab imposes that the participants get a maximum of 5 submissions per day during the development phase and 500 seconds of execution time per submission.