@philculliton \nHi, sorry for another \"clarification needed\" topic, but I just now realized there's some confusing information in the Rules page\nIn the beginning we have: \"You may select up to 2 final submissions for judging.\"
\n\nLater in the competition-specific rules we have:\nMODEL UPLOAD REQUIREMENT.\nIn order to be eligible for Stage 2, each team's Stage 1 submission must include the model uploaded, via Team -> Your Model. This model should match that which was used to generate the 1 final submission selected for scoring. Be aware that if you do not select a final submission (via 'My Submissions'), the platform will auto-select your best-scoring model on the Stage 1 public leaderboard.
\n\nThe specific rules mention 1 submission - and also the auto-selection would only choose \"best scoring model\" which hints at \"single best model\"
\n\nthanks for clarifying
", "messages": [ { "id": 633124, "postDate": "2019-09-24T13:08:57.923Z", "content": "@philculliton \nHi, sorry for another \"clarification needed\" topic, but I just now realized there's some confusing information in the Rules page\nIn the beginning we have: \"You may select up to 2 final submissions for judging.\"
\n\nLater in the competition-specific rules we have:\nMODEL UPLOAD REQUIREMENT.\nIn order to be eligible for Stage 2, each team's Stage 1 submission must include the model uploaded, via Team -> Your Model. This model should match that which was used to generate the 1 final submission selected for scoring. Be aware that if you do not select a final submission (via 'My Submissions'), the platform will auto-select your best-scoring model on the Stage 1 public leaderboard.
\n\nThe specific rules mention 1 submission - and also the auto-selection would only choose \"best scoring model\" which hints at \"single best model\"
\n\nthanks for clarifying
", "rawMarkdown": "@philculliton \nHi, sorry for another \"clarification needed\" topic, but I just now realized there's some confusing information in the Rules page\nIn the beginning we have: \"You may select **up to 2 final submissions** for judging.\"\n\nLater in the competition-specific rules we have:\nMODEL UPLOAD REQUIREMENT.\nIn order to be eligible for Stage 2, each team's Stage 1 submission must include the model uploaded, via Team -> Your Model. This model should match that which was used to generate the **1 final submission** selected for scoring. Be aware that if you do not select a final submission (via 'My Submissions'), the platform will auto-select **your best-scoring model** on the Stage 1 public leaderboard. \n\nThe specific rules mention 1 submission - and also the auto-selection would only choose \"best scoring model\" which hints at \"single best model\"\n\nthanks for clarifying", "votes": 3 }, { "id": 633267, "postDate": "2019-09-24T16:32:21.753Z", "content": "Hi, thank you for calling this out. This was a mis-type on my part. I've now fixed it. Sorry for the confusion!
\n\nTo be clear - you are permitted to make 2 final submission selections for private leaderboard scoring in this competition. You should wait until Stage 2 to do this. Your 2 final submission selections must be made by the models uploaded in Stage 1. The host will check that winners are not in violation of this rule, and making any disallowed changes to your code between Stage 1 and Stage 2 could result in disqualification and removal from the final leaderboard.
", "rawMarkdown": "Hi, thank you for calling this out. This was a mis-type on my part. I've now fixed it. Sorry for the confusion!\n\nTo be clear - you are permitted to make 2 final submission selections for private leaderboard scoring in this competition. You should wait until Stage 2 to do this. Your 2 final submission selections must be made by the models uploaded in Stage 1. The host will check that winners are not in violation of this rule, and making any disallowed changes to your code between Stage 1 and Stage 2 could result in disqualification and removal from the final leaderboard.", "votes": 4, "replies": [ { "id": 633278, "postDate": "2019-09-24T16:58:31.047Z", "content": "thanks
", "rawMarkdown": "thanks", "votes": 1 }, { "id": 633566, "postDate": "2019-09-25T06:15:36.537Z", "content": "Hey i am super confused about this, are we allowed to upload more than 2 models? if we want to ensemble do we restrict it to only 2 models?
", "rawMarkdown": "Hey i am super confused about this, are we allowed to upload more than 2 models? if we want to ensemble do we restrict it to only 2 models?", "votes": 3 }, { "id": 633884, "postDate": "2019-09-25T14:38:36.683Z", "content": "You may only upload up to 2 models by the end of stage 1. These must represent the models you will use in stage 2. They can be zipped together to upload. And no, more than 2 is not permitted.
", "rawMarkdown": "You may only upload up to 2 models by the end of stage 1. These must represent the models you will use in stage 2. They can be zipped together to upload. And no, more than 2 is not permitted.", "votes": -1 }, { "id": 633928, "postDate": "2019-09-25T15:40:27.213Z", "content": "@juliaelliott I still experience some confusion (sorry about this). What do you mean by 2 models exactly? Two zip files (one zip file per submission selected)? Or two neural nets? For example, I might use an ensemble prediction for my submission, meaning that I will use an ensemble of neural nets to generate the predictions for a submission file. It (the ensemble) could be seen as 1 model or multiple models generating a prediction.
", "rawMarkdown": "@juliaelliott I still experience some confusion (sorry about this). What do you mean by 2 models exactly? Two zip files (one zip file per submission selected)? Or two neural nets? For example, I might use an ensemble prediction for my submission, meaning that I will use an ensemble of neural nets to generate the predictions for *a* submission file. It (the ensemble) could be seen as 1 model or multiple models generating *a* prediction.", "votes": 1 }, { "id": 633956, "postDate": "2019-09-25T16:06:57.990Z", "content": "1 model = that model or ensemble of models which will, in the end, be generating your predictions. So yes, 1 model could constitute an ensemble.
\n\nYou can only upload one file - so you'll have to zip everything together from the 2 models you submit (including the ensembles, if either model includes ensembles).
", "rawMarkdown": "1 model = that model or ensemble of models which will, in the end, be generating your predictions. So yes, 1 model could constitute an ensemble.\n\nYou can only upload one file - so you'll have to zip everything together from the 2 models you submit (including the ensembles, if either model includes ensembles).", "votes": 1 }, { "id": 634010, "postDate": "2019-09-25T17:36:18.903Z", "content": "@juliaelliott Thanks
", "rawMarkdown": "@juliaelliott Thanks" }, { "id": 634041, "postDate": "2019-09-25T18:27:45.063Z", "content": "Thank you!
", "rawMarkdown": "Thank you!" } ] } ], "comments": [ { "id": 633267, "author_name": "Julia Elliott", "author_url": "", "post_date": "2019-09-24T16:32:21.753000", "content": "Hi, thank you for calling this out. This was a mis-type on my part. I've now fixed it. Sorry for the confusion!
\n\nTo be clear - you are permitted to make 2 final submission selections for private leaderboard scoring in this competition. You should wait until Stage 2 to do this. Your 2 final submission selections must be made by the models uploaded in Stage 1. The host will check that winners are not in violation of this rule, and making any disallowed changes to your code between Stage 1 and Stage 2 could result in disqualification and removal from the final leaderboard.
", "votes": 4, "replies": [ { "id": 633278, "author_name": "steelrose", "author_url": "", "post_date": "2019-09-24T16:58:31.047000", "content": "thanks
", "votes": 1, "replies": [] }, { "id": 633566, "author_name": "DecentMakeover", "author_url": "", "post_date": "2019-09-25T06:15:36.537000", "content": "Hey i am super confused about this, are we allowed to upload more than 2 models? if we want to ensemble do we restrict it to only 2 models?
", "votes": 3, "replies": [] }, { "id": 633884, "author_name": "Julia Elliott", "author_url": "", "post_date": "2019-09-25T14:38:36.683000", "content": "You may only upload up to 2 models by the end of stage 1. These must represent the models you will use in stage 2. They can be zipped together to upload. And no, more than 2 is not permitted.
", "votes": -1, "replies": [] }, { "id": 633928, "author_name": "Alex", "author_url": "", "post_date": "2019-09-25T15:40:27.213000", "content": "@juliaelliott I still experience some confusion (sorry about this). What do you mean by 2 models exactly? Two zip files (one zip file per submission selected)? Or two neural nets? For example, I might use an ensemble prediction for my submission, meaning that I will use an ensemble of neural nets to generate the predictions for a submission file. It (the ensemble) could be seen as 1 model or multiple models generating a prediction.
", "votes": 1, "replies": [] }, { "id": 633956, "author_name": "Julia Elliott", "author_url": "", "post_date": "2019-09-25T16:06:57.990000", "content": "1 model = that model or ensemble of models which will, in the end, be generating your predictions. So yes, 1 model could constitute an ensemble.
\n\nYou can only upload one file - so you'll have to zip everything together from the 2 models you submit (including the ensembles, if either model includes ensembles).
", "votes": 1, "replies": [] }, { "id": 634010, "author_name": "DecentMakeover", "author_url": "", "post_date": "2019-09-25T17:36:18.903000", "content": "@juliaelliott Thanks
", "votes": 0, "replies": [] }, { "id": 634041, "author_name": "Alex", "author_url": "", "post_date": "2019-09-25T18:27:45.063000", "content": "Thank you!
", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "633124": "@philculliton \nHi, sorry for another \"clarification needed\" topic, but I just now realized there's some confusing information in the Rules page\nIn the beginning we have: \"You may select **up to 2 final submissions** for judging.\"\n\nLater in the competition-specific rules we have:\nMODEL UPLOAD REQUIREMENT.\nIn order to be eligible for Stage 2, each team's Stage 1 submission must include the model uploaded, via Team -> Your Model. This model should match that which was used to generate the **1 final submission** selected for scoring. Be aware that if you do not select a final submission (via 'My Submissions'), the platform will auto-select **your best-scoring model** on the Stage 1 public leaderboard. \n\nThe specific rules mention 1 submission - and also the auto-selection would only choose \"best scoring model\" which hints at \"single best model\"\n\nthanks for clarifying", "633267": "Hi, thank you for calling this out. This was a mis-type on my part. I've now fixed it. Sorry for the confusion!\n\nTo be clear - you are permitted to make 2 final submission selections for private leaderboard scoring in this competition. You should wait until Stage 2 to do this. Your 2 final submission selections must be made by the models uploaded in Stage 1. The host will check that winners are not in violation of this rule, and making any disallowed changes to your code between Stage 1 and Stage 2 could result in disqualification and removal from the final leaderboard." } }