Skip to content

Commit 44cdb3a

Browse files
authored
clarifications after deciding how to score
1 parent c695c0c commit 44cdb3a

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

README.md

+4-2
Original file line numberDiff line numberDiff line change
@@ -29,17 +29,19 @@ Please refer to the [User guide to the geophysical tutorials](http://library.seg
2929

3030
## Find out more about the contest
3131

32+
If you intend to enter this contest, I suggest you check [the open issues](https://github.com/seg/2016-ml-contest/issues) and read through [the closed issues](https://github.com/seg/2016-ml-contest/issues?q=is%3Aissue+is%3Aclosed) too. There's some good info in there.
33+
3234
To find out more please read the article in [the October issue](http://library.seg.org/toc/leedff/35/10) or read the manuscript in the [`tutorials-2016`](https://github.com/seg/tutorials-2016) repo.
3335

3436

3537
## Rules
3638

3739
We've never done anything like this before, so there's a good chance these rules will become clearer as we go. We aim to be fair at all times, and reserve the right to make judgment calls for dealing with unforeseen circumstances.
3840

39-
**IMPORTANT: When this contest was first published, we asked you to hold the SHANKLE well blind. This is no longer necessary. You can use all the published wells in your training. Related: I am removin the file of predicted facies for the STUART and CRAWFORD wells, to reduce confusion — they are not actual facies, only those predicted by Brendon's first model.**
41+
**IMPORTANT: When this contest was first published, we asked you to hold the SHANKLE well blind. This is no longer necessary. You can use all the published wells in your training. Related: I am removing the file of predicted facies for the STUART and CRAWFORD wells, to reduce confusion — they are not actual facies, only those predicted by Brendon's first model.**
4042

4143
- You must submit your result as code and we must be able to run your code.
42-
- **We are still working out the exact details of the comparison criteria. It will likely be a comparison against known facies in the STUART and CRAWFORD wells, which do not have labels in the contest dataset.** See [issue #2 regarding this point.](https://github.com/seg/2016-ml-contest/issues/2).
44+
- **Entries will be scored by a comparison against known facies in the STUART and CRAWFORD wells, which do not have labels in the contest dataset. We will use the F1 cross-validation score.** See [issue #2 regarding this point.](https://github.com/seg/2016-ml-contest/issues/2). The scores in the 'leaderboard' reflect this.
4345
- The result we get with your code is the one that counts as your result.
4446
- To make it more likely that we can run it, your code must be written in Python or R or Julia **or Lua** [updated 26 Oct].
4547
- The contest is over at 23:59:59 UT (i.e. midnight in London, UK) on 31 January 2017. Pull requests made aftetr that time won't be eligible for the contest.

0 commit comments

Comments
 (0)