{
  "id": 386286,
  "title": "Some Questions about pF1 score Maximization",
  "url": "/competitions/rsna-breast-cancer-detection/discussion/386286",
  "author_name": "Lau2664",
  "post_date": "2023-02-12T09:38:02.874000",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I used different thresholds to maximize the pf1 score on validation dataset, and the best thr I found is 0.65 at which the pf1 score is 0.30. When I submit my notebook, I accidentally use a wrong thr which is 0.85. However, the result is surprising, I got a 0.45 score on LB with the wrong thr, and only 0.3 on LB with the best thr I found. How does that happen? </p>",
  "messages": [
    {
      "id": 2141594,
      "postDate": "2023-02-12T22:21:44.120Z",
      "content": "<p>Does this mean that LB is easily overfitted? Big shake at the end of the competition?</p>",
      "rawMarkdown": "Does this mean that LB is easily overfitted? Big shake at the end of the competition?",
      "votes": 3,
      "replies": [
        {
          "id": 2143904,
          "postDate": "2023-02-14T16:03:21.327Z",
          "content": "<p>I think so, there were other posts about the gap between CV F1 score and the LB score. One person got 0.35 CV and 0.51 F1 score I think.</p>",
          "rawMarkdown": "I think so, there were other posts about the gap between CV F1 score and the LB score. One person got 0.35 CV and 0.51 F1 score I think."
        }
      ]
    },
    {
      "id": 2140927,
      "postDate": "2023-02-12T09:38:02.873Z",
      "content": "<p>I used different thresholds to maximize the pf1 score on validation dataset, and the best thr I found is 0.65 at which the pf1 score is 0.30. When I submit my notebook, I accidentally use a wrong thr which is 0.85. However, the result is surprising, I got a 0.45 score on LB with the wrong thr, and only 0.3 on LB with the best thr I found. How does that happen? </p>",
      "rawMarkdown": "I used different thresholds to maximize the pf1 score on validation dataset, and the best thr I found is 0.65 at which the pf1 score is 0.30. When I submit my notebook, I accidentally use a wrong thr which is 0.85. However, the result is surprising, I got a 0.45 score on LB with the wrong thr, and only 0.3 on LB with the best thr I found. How does that happen? ",
      "votes": 1
    },
    {
      "id": 2143799,
      "postDate": "2023-02-14T14:12:10.160Z",
      "content": "<p>What score LB pF1 do you get without threshold?</p>",
      "rawMarkdown": "What score LB pF1 do you get without threshold?"
    }
  ],
  "comments": [
    {
      "id": 2141594,
      "author_name": "Chen Lin",
      "author_url": "",
      "post_date": "2023-02-12T22:21:44.120000",
      "content": "<p>Does this mean that LB is easily overfitted? Big shake at the end of the competition?</p>",
      "votes": 3,
      "replies": [
        {
          "id": 2143904,
          "author_name": "Naman Makkar",
          "author_url": "",
          "post_date": "2023-02-14T16:03:21.327000",
          "content": "<p>I think so, there were other posts about the gap between CV F1 score and the LB score. One person got 0.35 CV and 0.51 F1 score I think.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 2143799,
      "author_name": "Bill Qi",
      "author_url": "",
      "post_date": "2023-02-14T14:12:10.160000",
      "content": "<p>What score LB pF1 do you get without threshold?</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2141594": "Does this mean that LB is easily overfitted? Big shake at the end of the competition?",
    "2140927": "I used different thresholds to maximize the pf1 score on validation dataset, and the best thr I found is 0.65 at which the pf1 score is 0.30. When I submit my notebook, I accidentally use a wrong thr which is 0.85. However, the result is surprising, I got a 0.45 score on LB with the wrong thr, and only 0.3 on LB with the best thr I found. How does that happen? ",
    "2143799": "What score LB pF1 do you get without threshold?"
  }
}