-
Notifications
You must be signed in to change notification settings - Fork 4
Help: Wizard ‐ Challenge ‐ Baseline
Isabelle Guyon edited this page Aug 28, 2017
·
4 revisions
You must supply a so-called "Starting kit" that will allow the participants to create sample code and result submissions. DOWNLOAD AN EXAMPLE.
We recommend to provide in the starting kit:
- A README file (preferably in the form of a iPython notebook.
- Some sample data resembling the task of the challenge, but SMALL for easy download and practice.
- Some examples of data visualisation functions.
- The metric function used to score the challenge.
- A sample result submission ready-to-upload, providing predictions in the correct format.
- An example of predictor class (a classifier or regressor). If scikit-learn is used, this class will have a "fit" and a "predict" method.
- An example of "unit test" for the predictor class, for example a cross-validation loop calling "fit" to train and "predict" to test, then calling the scoring metric to compute performance.
- A call to a function that zips the code or prediction results to create ready-to-upload submissions.