{
  "id": 390676,
  "title": "Don't submit your best LB score.",
  "url": "/competitions/rsna-breast-cancer-detection/discussion/390676",
  "author_name": "Hyunsoo Lee 1010",
  "post_date": "2023-02-26T18:02:47.526000",
  "votes": 2,
  "comment_count": 4,
  "views": 0,
  "content": "<p>For me, this is my first competition in Kaggle. So, I have focused on improving LB score. However, the following post is waking me up. </p>\n<p>Check out this link : <a href=\"https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/281347\" target=\"_blank\">1st place solution with very simple code</a></p>\n<p>All kinds of Kaggle competition is this like? or this competition is a special case in which we don't have to trust only LB score?</p>\n<p>Thanks.</p>\n<p>(Edited) we have to no worry about that at some ponit. (this competition has a lot of data giving us.) Therefore I would submit one of my best LB.</p>",
  "messages": [
    {
      "id": 2160589,
      "postDate": "2023-02-26T19:37:34.990Z",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F18102%2Fc50175e7f54b7010e3deb5efa025c063%2Fchance.png?generation=1677440251086831&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F18102%2Fc50175e7f54b7010e3deb5efa025c063%2Fchance.png?generation=1677440251086831&alt=media)",
      "votes": 15
    },
    {
      "id": 2161301,
      "postDate": "2023-02-27T11:34:38.377Z",
      "content": "<p>The only thing those two competitions have in common is RSNA in their names. They are completely different. This one has an unstable metric but the other one doesn't have signal in data. My 10 model ensemble was barely reaching 0.65 AUC in that competition but I can reach 0.89 AUC with a single model here. </p>",
      "rawMarkdown": "The only thing those two competitions have in common is RSNA in their names. They are completely different. This one has an unstable metric but the other one doesn't have signal in data. My 10 model ensemble was barely reaching 0.65 AUC in that competition but I can reach 0.89 AUC with a single model here. ",
      "votes": 9
    },
    {
      "id": 2160555,
      "postDate": "2023-02-26T18:58:46.703Z",
      "content": "<p>The competition you are referring to was arguably truly random leaderboard… more details on that <a href=\"https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/279820\" target=\"_blank\">here</a></p>\n<p>But, yes, generally when the public leaderboard is small or noisy it might be better to choose submissions with the best local CV</p>",
      "rawMarkdown": "The competition you are referring to was arguably truly random leaderboard... more details on that [here](https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/279820)\n\nBut, yes, generally when the public leaderboard is small or noisy it might be better to choose submissions with the best local CV",
      "votes": 7
    },
    {
      "id": 2160488,
      "postDate": "2023-02-26T18:02:47.527Z",
      "content": "<p>For me, this is my first competition in Kaggle. So, I have focused on improving LB score. However, the following post is waking me up. </p>\n<p>Check out this link : <a href=\"https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/281347\" target=\"_blank\">1st place solution with very simple code</a></p>\n<p>All kinds of Kaggle competition is this like? or this competition is a special case in which we don't have to trust only LB score?</p>\n<p>Thanks.</p>\n<p>(Edited) we have to no worry about that at some ponit. (this competition has a lot of data giving us.) Therefore I would submit one of my best LB.</p>",
      "rawMarkdown": "For me, this is my first competition in Kaggle. So, I have focused on improving LB score. However, the following post is waking me up. \n\nCheck out this link : [1st place solution with very simple code](https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/281347)\n\nAll kinds of Kaggle competition is this like? or this competition is a special case in which we don't have to trust only LB score?\n\nThanks.\n\n(Edited) we have to no worry about that at some ponit. (this competition has a lot of data giving us.) Therefore I would submit one of my best LB.",
      "votes": 2
    },
    {
      "id": 2160893,
      "postDate": "2023-02-27T04:15:23.520Z",
      "content": "<p>My story after I end up on the wrong side of Shakeups on Kaggle 😂</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F573171%2F7ad3c533384bce69b61ceff933ef76fc%2Fa73dLxw_700b.jpg?generation=1677471216619320&amp;alt=media\" alt=\" \"></p>",
      "rawMarkdown": "My story after I end up on the wrong side of Shakeups on Kaggle 😂\n\n![ ](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F573171%2F7ad3c533384bce69b61ceff933ef76fc%2Fa73dLxw_700b.jpg?generation=1677471216619320&alt=media)",
      "votes": 2
    }
  ],
  "comments": [
    {
      "id": 2160589,
      "author_name": "beluga",
      "author_url": "",
      "post_date": "2023-02-26T19:37:34.990000",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F18102%2Fc50175e7f54b7010e3deb5efa025c063%2Fchance.png?generation=1677440251086831&amp;alt=media\" alt=\"\"></p>",
      "votes": 15,
      "replies": []
    },
    {
      "id": 2161301,
      "author_name": "Gunes Evitan",
      "author_url": "",
      "post_date": "2023-02-27T11:34:38.377000",
      "content": "<p>The only thing those two competitions have in common is RSNA in their names. They are completely different. This one has an unstable metric but the other one doesn't have signal in data. My 10 model ensemble was barely reaching 0.65 AUC in that competition but I can reach 0.89 AUC with a single model here. </p>",
      "votes": 9,
      "replies": []
    },
    {
      "id": 2160555,
      "author_name": "Harshit Sheoran",
      "author_url": "",
      "post_date": "2023-02-26T18:58:46.703000",
      "content": "<p>The competition you are referring to was arguably truly random leaderboard… more details on that <a href=\"https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/279820\" target=\"_blank\">here</a></p>\n<p>But, yes, generally when the public leaderboard is small or noisy it might be better to choose submissions with the best local CV</p>",
      "votes": 7,
      "replies": []
    },
    {
      "id": 2160893,
      "author_name": "sandy1112",
      "author_url": "",
      "post_date": "2023-02-27T04:15:23.520000",
      "content": "<p>My story after I end up on the wrong side of Shakeups on Kaggle 😂</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F573171%2F7ad3c533384bce69b61ceff933ef76fc%2Fa73dLxw_700b.jpg?generation=1677471216619320&amp;alt=media\" alt=\" \"></p>",
      "votes": 2,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2160589": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F18102%2Fc50175e7f54b7010e3deb5efa025c063%2Fchance.png?generation=1677440251086831&alt=media)",
    "2161301": "The only thing those two competitions have in common is RSNA in their names. They are completely different. This one has an unstable metric but the other one doesn't have signal in data. My 10 model ensemble was barely reaching 0.65 AUC in that competition but I can reach 0.89 AUC with a single model here. ",
    "2160555": "The competition you are referring to was arguably truly random leaderboard... more details on that [here](https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/279820)\n\nBut, yes, generally when the public leaderboard is small or noisy it might be better to choose submissions with the best local CV",
    "2160488": "For me, this is my first competition in Kaggle. So, I have focused on improving LB score. However, the following post is waking me up. \n\nCheck out this link : [1st place solution with very simple code](https://www.kaggle.com/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/281347)\n\nAll kinds of Kaggle competition is this like? or this competition is a special case in which we don't have to trust only LB score?\n\nThanks.\n\n(Edited) we have to no worry about that at some ponit. (this competition has a lot of data giving us.) Therefore I would submit one of my best LB.",
    "2160893": "My story after I end up on the wrong side of Shakeups on Kaggle 😂\n\n![ ](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F573171%2F7ad3c533384bce69b61ceff933ef76fc%2Fa73dLxw_700b.jpg?generation=1677471216619320&alt=media)"
  }
}