{
  "id": 335697,
  "title": "LeaderBoard Probing strategies",
  "url": "/competitions/mayo-clinic-strip-ai/discussion/335697",
  "author_name": "Towhidul.Tonmoy",
  "post_date": "2022-07-07T12:20:50.512000",
  "votes": 8,
  "comment_count": 3,
  "views": 0,
  "content": "<p><strong>What is LB probing?</strong></p>\n<blockquote>\n  <p>We can make any number of Submissions to check the leaderboard score. This technique is called <strong>leaderboard probing</strong> as we have tuned our models based on leaderboard ccore instead of an essential Local Cross-Validation Score .</p>\n</blockquote>\n<p>[Source: <a href=\"https://www.analyticsvidhya.com/blog/2020/10/ultimate-beginners-guide-top-10-machine-learning-hackathons/\" target=\"_blank\">https://www.analyticsvidhya.com/blog/2020/10/ultimate-beginners-guide-top-10-machine-learning-hackathons/</a>]</p>\n<blockquote>\n  <p>For this competition, LB probing will be helpful for understanding the class weights.</p>\n</blockquote>\n<p>For beginners, who are not aware of LB proving, you can check out this amazing post.<br>\n<a href=\"https://joshvarty.com/2019/09/29/probing-kaggle-dice-score/\" target=\"_blank\">Probing Kaggle Leaderboards with Dice Score</a></p>\n<blockquote>\n  <p><strong>Notebooks:</strong><br>\n  <a href=\"https://www.kaggle.com/code/ryotayoshinobu/how-to-do-leaderboard-probing/notebook\" target=\"_blank\">How to do Leaderboard Probing</a><br>\n  <a href=\"https://www.kaggle.com/code/tanlikesmath/private-lb-probing-adversarial-validation\" target=\"_blank\">Private LB probing - adversarial validation</a><br>\n  <a href=\"https://www.kaggle.com/code/cdeotte/private-lb-probing-0-950\" target=\"_blank\">Private LB Probing - [0.950]</a><br>\n  <a href=\"https://www.kaggle.com/code/keremt/understanding-evaluation-lb-probing?scriptVersionId=64877409\" target=\"_blank\">Understanding Evaluation (LB Probing)</a><br>\n  <a href=\"https://www.kaggle.com/code/mbrown89/boost-your-score-guaranteed-leaderboard-probing/notebook\" target=\"_blank\">Boost Your Score Guaranteed (Leaderboard Probing)</a><br>\n  <a href=\"https://www.kaggle.com/code/ambrosm/tpsnov21-012-leaderboard-probing/notebook\" target=\"_blank\">TPSNOV21-012-Leaderboard Probing</a><br>\n  <a href=\"https://www.kaggle.com/code/alpharadia/lb-probing-public-private-split-and-simple-season\" target=\"_blank\">LB probing, public/private split and simple season</a><br>\n  <strong>Discussion:</strong><br>\n  <a href=\"https://www.kaggle.com/competitions/prostate-cancer-grade-assessment/discussion/158687\" target=\"_blank\">An efficient way to probe LB</a></p>\n</blockquote>",
  "messages": [
    {
      "id": 1846872,
      "postDate": "2022-07-07T12:20:50.513Z",
      "content": "<p><strong>What is LB probing?</strong></p>\n<blockquote>\n  <p>We can make any number of Submissions to check the leaderboard score. This technique is called <strong>leaderboard probing</strong> as we have tuned our models based on leaderboard ccore instead of an essential Local Cross-Validation Score .</p>\n</blockquote>\n<p>[Source: <a href=\"https://www.analyticsvidhya.com/blog/2020/10/ultimate-beginners-guide-top-10-machine-learning-hackathons/\" target=\"_blank\">https://www.analyticsvidhya.com/blog/2020/10/ultimate-beginners-guide-top-10-machine-learning-hackathons/</a>]</p>\n<blockquote>\n  <p>For this competition, LB probing will be helpful for understanding the class weights.</p>\n</blockquote>\n<p>For beginners, who are not aware of LB proving, you can check out this amazing post.<br>\n<a href=\"https://joshvarty.com/2019/09/29/probing-kaggle-dice-score/\" target=\"_blank\">Probing Kaggle Leaderboards with Dice Score</a></p>\n<blockquote>\n  <p><strong>Notebooks:</strong><br>\n  <a href=\"https://www.kaggle.com/code/ryotayoshinobu/how-to-do-leaderboard-probing/notebook\" target=\"_blank\">How to do Leaderboard Probing</a><br>\n  <a href=\"https://www.kaggle.com/code/tanlikesmath/private-lb-probing-adversarial-validation\" target=\"_blank\">Private LB probing - adversarial validation</a><br>\n  <a href=\"https://www.kaggle.com/code/cdeotte/private-lb-probing-0-950\" target=\"_blank\">Private LB Probing - [0.950]</a><br>\n  <a href=\"https://www.kaggle.com/code/keremt/understanding-evaluation-lb-probing?scriptVersionId=64877409\" target=\"_blank\">Understanding Evaluation (LB Probing)</a><br>\n  <a href=\"https://www.kaggle.com/code/mbrown89/boost-your-score-guaranteed-leaderboard-probing/notebook\" target=\"_blank\">Boost Your Score Guaranteed (Leaderboard Probing)</a><br>\n  <a href=\"https://www.kaggle.com/code/ambrosm/tpsnov21-012-leaderboard-probing/notebook\" target=\"_blank\">TPSNOV21-012-Leaderboard Probing</a><br>\n  <a href=\"https://www.kaggle.com/code/alpharadia/lb-probing-public-private-split-and-simple-season\" target=\"_blank\">LB probing, public/private split and simple season</a><br>\n  <strong>Discussion:</strong><br>\n  <a href=\"https://www.kaggle.com/competitions/prostate-cancer-grade-assessment/discussion/158687\" target=\"_blank\">An efficient way to probe LB</a></p>\n</blockquote>",
      "rawMarkdown": "**What is LB probing?**\n\n> We can make any number of Submissions to check the leaderboard score. This technique is called **leaderboard probing** as we have tuned our models based on leaderboard ccore instead of an essential Local Cross-Validation Score .\n\n[Source: https://www.analyticsvidhya.com/blog/2020/10/ultimate-beginners-guide-top-10-machine-learning-hackathons/]\n\n> For this competition, LB probing will be helpful for understanding the class weights.\n\nFor beginners, who are not aware of LB proving, you can check out this amazing post.\n[Probing Kaggle Leaderboards with Dice Score](https://joshvarty.com/2019/09/29/probing-kaggle-dice-score/)\n\n\n> **Notebooks:**\n[How to do Leaderboard Probing](https://www.kaggle.com/code/ryotayoshinobu/how-to-do-leaderboard-probing/notebook)\n[Private LB probing - adversarial validation](https://www.kaggle.com/code/tanlikesmath/private-lb-probing-adversarial-validation)\n[Private LB Probing - [0.950]](https://www.kaggle.com/code/cdeotte/private-lb-probing-0-950)\n[Understanding Evaluation (LB Probing)](https://www.kaggle.com/code/keremt/understanding-evaluation-lb-probing?scriptVersionId=64877409)\n[Boost Your Score Guaranteed (Leaderboard Probing)](https://www.kaggle.com/code/mbrown89/boost-your-score-guaranteed-leaderboard-probing/notebook)\n[TPSNOV21-012-Leaderboard Probing](https://www.kaggle.com/code/ambrosm/tpsnov21-012-leaderboard-probing/notebook)\n[LB probing, public/private split and simple season](https://www.kaggle.com/code/alpharadia/lb-probing-public-private-split-and-simple-season)\n**Discussion:**\n[An efficient way to probe LB](https://www.kaggle.com/competitions/prostate-cancer-grade-assessment/discussion/158687)\n\n\n",
      "votes": 7
    },
    {
      "id": 1848437,
      "postDate": "2022-07-08T16:15:15.817Z",
      "content": "<p>i was searching for this. thanks a lot for sharing. </p>",
      "rawMarkdown": "i was searching for this. thanks a lot for sharing. ",
      "votes": 1,
      "replies": [
        {
          "id": 1848445,
          "postDate": "2022-07-08T16:21:15.697Z",
          "content": "<p>Glad you found it helpful! </p>",
          "rawMarkdown": "Glad you found it helpful! "
        }
      ]
    },
    {
      "id": 1856857,
      "postDate": "2022-07-15T16:40:05.440Z",
      "content": "<p>Thanks for your sharing！</p>",
      "rawMarkdown": "Thanks for your sharing！"
    }
  ],
  "comments": [
    {
      "id": 1848437,
      "author_name": "Hasanga Methmal",
      "author_url": "",
      "post_date": "2022-07-08T16:15:15.817000",
      "content": "<p>i was searching for this. thanks a lot for sharing. </p>",
      "votes": 1,
      "replies": [
        {
          "id": 1848445,
          "author_name": "Towhidul.Tonmoy",
          "author_url": "",
          "post_date": "2022-07-08T16:21:15.697000",
          "content": "<p>Glad you found it helpful! </p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1856857,
      "author_name": "豆柴金鯱",
      "author_url": "",
      "post_date": "2022-07-15T16:40:05.440000",
      "content": "<p>Thanks for your sharing！</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1846872": "**What is LB probing?**\n\n> We can make any number of Submissions to check the leaderboard score. This technique is called **leaderboard probing** as we have tuned our models based on leaderboard ccore instead of an essential Local Cross-Validation Score .\n\n[Source: https://www.analyticsvidhya.com/blog/2020/10/ultimate-beginners-guide-top-10-machine-learning-hackathons/]\n\n> For this competition, LB probing will be helpful for understanding the class weights.\n\nFor beginners, who are not aware of LB proving, you can check out this amazing post.\n[Probing Kaggle Leaderboards with Dice Score](https://joshvarty.com/2019/09/29/probing-kaggle-dice-score/)\n\n\n> **Notebooks:**\n[How to do Leaderboard Probing](https://www.kaggle.com/code/ryotayoshinobu/how-to-do-leaderboard-probing/notebook)\n[Private LB probing - adversarial validation](https://www.kaggle.com/code/tanlikesmath/private-lb-probing-adversarial-validation)\n[Private LB Probing - [0.950]](https://www.kaggle.com/code/cdeotte/private-lb-probing-0-950)\n[Understanding Evaluation (LB Probing)](https://www.kaggle.com/code/keremt/understanding-evaluation-lb-probing?scriptVersionId=64877409)\n[Boost Your Score Guaranteed (Leaderboard Probing)](https://www.kaggle.com/code/mbrown89/boost-your-score-guaranteed-leaderboard-probing/notebook)\n[TPSNOV21-012-Leaderboard Probing](https://www.kaggle.com/code/ambrosm/tpsnov21-012-leaderboard-probing/notebook)\n[LB probing, public/private split and simple season](https://www.kaggle.com/code/alpharadia/lb-probing-public-private-split-and-simple-season)\n**Discussion:**\n[An efficient way to probe LB](https://www.kaggle.com/competitions/prostate-cancer-grade-assessment/discussion/158687)\n\n\n",
    "1848437": "i was searching for this. thanks a lot for sharing. ",
    "1856857": "Thanks for your sharing！"
  }
}