Recognizing the confusion generated by the statement “Submission predictions must be based entirely on the pixel data in the provided datasets” and the implications it has on metadata usage, the organizers have decided to retract this rule. The initial intent of the rule was for the algorithm not rely on metadata in order to limit over-fitting and maximize generalizability of the solution based on pixel data only. Given that (1) this generated confusion around metadata usage for preprocessing/model creation capabilities, (2) recognizing the metadata provided in the dataset is de-identified and the available fields do not contain information that can determine if an image contains intracranial hemorrhage, and (3) with the intent not to stifle creativity, the organizing committee has decided to retract this rule and allow all metadata to be used for model creation.
\n\nChallenge Organizing Team
", "messages": [ { "id": 641544, "postDate": "2019-10-04T19:31:00.850Z", "content": "Recognizing the confusion generated by the statement “Submission predictions must be based entirely on the pixel data in the provided datasets” and the implications it has on metadata usage, the organizers have decided to retract this rule. The initial intent of the rule was for the algorithm not rely on metadata in order to limit over-fitting and maximize generalizability of the solution based on pixel data only. Given that (1) this generated confusion around metadata usage for preprocessing/model creation capabilities, (2) recognizing the metadata provided in the dataset is de-identified and the available fields do not contain information that can determine if an image contains intracranial hemorrhage, and (3) with the intent not to stifle creativity, the organizing committee has decided to retract this rule and allow all metadata to be used for model creation.
\n\nChallenge Organizing Team
", "rawMarkdown": "Recognizing the confusion generated by the statement “Submission predictions must be based entirely on the pixel data in the provided datasets” and the implications it has on metadata usage, the organizers have decided to retract this rule. The initial intent of the rule was for the algorithm not rely on metadata in order to limit over-fitting and maximize generalizability of the solution based on pixel data only. Given that (1) this generated confusion around metadata usage for preprocessing/model creation capabilities, (2) recognizing the metadata provided in the dataset is de-identified and the available fields do not contain information that can determine if an image contains intracranial hemorrhage, and (3) with the intent not to stifle creativity, the organizing committee has decided to retract this rule and allow all metadata to be used for model creation.\n\nChallenge Organizing Team\n", "votes": 53 }, { "id": 641649, "postDate": "2019-10-04T23:06:56.833Z", "content": "@lechuck0 could you also clarify the 2nd stage of the competition? Will it be from the same machines and institutions? Will there be any systematic change in data distribution (i.e. different mix of patients, different time period, etc)?
\n\nKnowing this will allow the competitors to ensure their models do a better job of matching with your goals in the competition.
", "rawMarkdown": "@lechuck0 could you also clarify the 2nd stage of the competition? Will it be from the same machines and institutions? Will there be any systematic change in data distribution (i.e. different mix of patients, different time period, etc)? \n\nKnowing this will allow the competitors to ensure their models do a better job of matching with your goals in the competition.", "votes": 16, "replies": [ { "id": 642358, "postDate": "2019-10-06T00:28:30.803Z", "content": "Stage 2’s dataset quality and time range will match Stage 1. Stage 2 will represent a distinct set of patients though.
", "rawMarkdown": "Stage 2’s dataset quality and time range will match Stage 1. Stage 2 will represent a distinct set of patients though. ", "votes": 6 } ] }, { "id": 641641, "postDate": "2019-10-04T22:22:42.107Z", "content": "Great decision - thanks so much for sorting this out folks! :)
", "rawMarkdown": "Great decision - thanks so much for sorting this out folks! :) ", "votes": 10 }, { "id": 641877, "postDate": "2019-10-05T08:59:50.423Z", "content": "Thank you for this! This opens up some interesting new avenues using 3D volumes.
\n\nFor those interested, I made a notebook here: https://www.kaggle.com/anjum48/reconstructing-3d-volumes-from-metadata
", "rawMarkdown": " Thank you for this! This opens up some interesting new avenues using 3D volumes.\n\nFor those interested, I made a notebook here: https://www.kaggle.com/anjum48/reconstructing-3d-volumes-from-metadata", "votes": 6 }, { "id": 644288, "postDate": "2019-10-08T15:34:39.887Z", "content": "I's say that this is amazing - AGILE from the organization. Respect!\nNow I can finally step in and do some work.\nMulti stage is good anyway.\nregards,\nA
", "rawMarkdown": "I's say that this is amazing - AGILE from the organization. Respect!\nNow I can finally step in and do some work.\nMulti stage is good anyway.\nregards,\nA", "votes": 2 }, { "id": 641633, "postDate": "2019-10-04T21:43:22.463Z", "content": "Thoughtful decision from the Organizing Team. Thanks for the clarification. This will increase the modeling possibilities in this challenge.
", "rawMarkdown": "Thoughtful decision from the Organizing Team. Thanks for the clarification. This will increase the modeling possibilities in this challenge.", "votes": 2 }, { "id": 650043, "postDate": "2019-10-16T03:24:23.323Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 641649, "author_name": "Jeremy Howard", "author_url": "", "post_date": "2019-10-04T23:06:56.833000", "content": "@lechuck0 could you also clarify the 2nd stage of the competition? Will it be from the same machines and institutions? Will there be any systematic change in data distribution (i.e. different mix of patients, different time period, etc)?
\n\nKnowing this will allow the competitors to ensure their models do a better job of matching with your goals in the competition.
", "votes": 16, "replies": [ { "id": 642358, "author_name": "Luciano Prevedello", "author_url": "", "post_date": "2019-10-06T00:28:30.803000", "content": "Stage 2’s dataset quality and time range will match Stage 1. Stage 2 will represent a distinct set of patients though.
", "votes": 6, "replies": [] } ] }, { "id": 641641, "author_name": "Jeremy Howard", "author_url": "", "post_date": "2019-10-04T22:22:42.107000", "content": "Great decision - thanks so much for sorting this out folks! :)
", "votes": 10, "replies": [] }, { "id": 641877, "author_name": "datasaurus", "author_url": "", "post_date": "2019-10-05T08:59:50.423000", "content": "Thank you for this! This opens up some interesting new avenues using 3D volumes.
\n\nFor those interested, I made a notebook here: https://www.kaggle.com/anjum48/reconstructing-3d-volumes-from-metadata
", "votes": 6, "replies": [] }, { "id": 644288, "author_name": "Adrian Zinovei", "author_url": "", "post_date": "2019-10-08T15:34:39.887000", "content": "I's say that this is amazing - AGILE from the organization. Respect!\nNow I can finally step in and do some work.\nMulti stage is good anyway.\nregards,\nA
", "votes": 2, "replies": [] }, { "id": 641633, "author_name": "FelipeKitamura, MD, PhD", "author_url": "", "post_date": "2019-10-04T21:43:22.463000", "content": "Thoughtful decision from the Organizing Team. Thanks for the clarification. This will increase the modeling possibilities in this challenge.
", "votes": 2, "replies": [] }, { "id": 650043, "author_name": "", "author_url": "", "post_date": "2019-10-16T03:24:23.323000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "641544": "Recognizing the confusion generated by the statement “Submission predictions must be based entirely on the pixel data in the provided datasets” and the implications it has on metadata usage, the organizers have decided to retract this rule. The initial intent of the rule was for the algorithm not rely on metadata in order to limit over-fitting and maximize generalizability of the solution based on pixel data only. Given that (1) this generated confusion around metadata usage for preprocessing/model creation capabilities, (2) recognizing the metadata provided in the dataset is de-identified and the available fields do not contain information that can determine if an image contains intracranial hemorrhage, and (3) with the intent not to stifle creativity, the organizing committee has decided to retract this rule and allow all metadata to be used for model creation.\n\nChallenge Organizing Team\n", "641649": "@lechuck0 could you also clarify the 2nd stage of the competition? Will it be from the same machines and institutions? Will there be any systematic change in data distribution (i.e. different mix of patients, different time period, etc)? \n\nKnowing this will allow the competitors to ensure their models do a better job of matching with your goals in the competition.", "641641": "Great decision - thanks so much for sorting this out folks! :) ", "641877": " Thank you for this! This opens up some interesting new avenues using 3D volumes.\n\nFor those interested, I made a notebook here: https://www.kaggle.com/anjum48/reconstructing-3d-volumes-from-metadata", "644288": "I's say that this is amazing - AGILE from the organization. Respect!\nNow I can finally step in and do some work.\nMulti stage is good anyway.\nregards,\nA", "641633": "Thoughtful decision from the Organizing Team. Thanks for the clarification. This will increase the modeling possibilities in this challenge.", "650043": "" } }