{
  "id": 342573,
  "title": "Please, is it possible add more digits to the Leaderboard?",
  "url": "/competitions/mayo-clinic-strip-ai/discussion/342573",
  "author_name": "Pablo Larrosa",
  "post_date": "2022-08-07T21:54:50.914000",
  "votes": 4,
  "comment_count": 9,
  "views": 0,
  "content": "<p>Hi <a href=\"https://www.kaggle.com/ashleychow\" target=\"_blank\">@ashleychow</a>, I don't know if it's possible to add more digits to the leaderboard because there are so many positions and I can't distinguish what the real difference in score is.</p>\n<p>Thanks in advance!</p>",
  "messages": [
    {
      "id": 1894390,
      "postDate": "2022-08-11T13:12:10.987Z",
      "content": "<p>Hey <a href=\"https://www.kaggle.com/pablolarrosa\" target=\"_blank\">@pablolarrosa</a> ,</p>\n<p>We've limited the leaderboard digits and number of submissions to help prevent probing. As another commenter mentioned, the public test set is very small and I'd caution against relying on the public LB; it's probably not very meaningful in this competition. You'll likely have the most success estimating the performance of your models with some kind of cross-validation procedure using the training data.</p>",
      "rawMarkdown": "Hey @pablolarrosa ,\n\nWe've limited the leaderboard digits and number of submissions to help prevent probing. As another commenter mentioned, the public test set is very small and I'd caution against relying on the public LB; it's probably not very meaningful in this competition. You'll likely have the most success estimating the performance of your models with some kind of cross-validation procedure using the training data.",
      "votes": 5,
      "replies": [
        {
          "id": 1894507,
          "postDate": "2022-08-11T14:44:43.287Z",
          "content": "<p>Thank you for the useful reply!</p>",
          "rawMarkdown": "Thank you for the useful reply!"
        }
      ]
    },
    {
      "id": 1888930,
      "postDate": "2022-08-07T21:54:50.913Z",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/ashleychow\" target=\"_blank\">@ashleychow</a>, I don't know if it's possible to add more digits to the leaderboard because there are so many positions and I can't distinguish what the real difference in score is.</p>\n<p>Thanks in advance!</p>",
      "rawMarkdown": "Hi @ashleychow, I don't know if it's possible to add more digits to the leaderboard because there are so many positions and I can't distinguish what the real difference in score is.\n\nThanks in advance!",
      "votes": 4
    },
    {
      "id": 1894428,
      "postDate": "2022-08-11T13:52:22.313Z",
      "content": "<p>Thank Ryan for your answer! , now I understand why Leaderboard had one digit.</p>",
      "rawMarkdown": "Thank Ryan for your answer! , now I understand why Leaderboard had one digit.",
      "votes": 1
    },
    {
      "id": 1904158,
      "postDate": "2022-08-18T02:26:00.513Z",
      "content": "<p>Hi, <a href=\"https://www.kaggle.com/ryanholbrook\" target=\"_blank\">@ryanholbrook</a> , So by the end of the competition the test-Image in Public will get Obsolete ?</p>",
      "rawMarkdown": "Hi, @ryanholbrook , So by the end of the competition the test-Image in Public will get Obsolete ?\n "
    },
    {
      "id": 1898045,
      "postDate": "2022-08-14T08:31:22.847Z",
      "content": "<p>Hi, <a href=\"https://www.kaggle.com/ryanholbrook\" target=\"_blank\">@ryanholbrook</a> , by the end of the competition the test images are the same?.</p>\n<p>Thanks!</p>",
      "rawMarkdown": "Hi, @ryanholbrook , by the end of the competition the test images are the same?.\n\nThanks!"
    },
    {
      "id": 1893716,
      "postDate": "2022-08-11T03:07:31.467Z",
      "content": "<p>Can the 3% public test data actually reflect the performance of your model?</p>",
      "rawMarkdown": "Can the 3% public test data actually reflect the performance of your model?",
      "replies": [
        {
          "id": 1894254,
          "postDate": "2022-08-11T11:00:24.117Z",
          "content": "<p>It's 7% actually, but still, you have a point. I think it's merely a rough indication.</p>",
          "rawMarkdown": "It's 7% actually, but still, you have a point. I think it's merely a rough indication."
        }
      ]
    },
    {
      "id": 1893434,
      "postDate": "2022-08-10T19:40:40.777Z",
      "content": "<p>gg good work man</p>",
      "rawMarkdown": "gg good work man\n"
    },
    {
      "id": 1892791,
      "postDate": "2022-08-10T10:34:11.803Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1894390,
      "author_name": "Ryan Holbrook",
      "author_url": "",
      "post_date": "2022-08-11T13:12:10.987000",
      "content": "<p>Hey <a href=\"https://www.kaggle.com/pablolarrosa\" target=\"_blank\">@pablolarrosa</a> ,</p>\n<p>We've limited the leaderboard digits and number of submissions to help prevent probing. As another commenter mentioned, the public test set is very small and I'd caution against relying on the public LB; it's probably not very meaningful in this competition. You'll likely have the most success estimating the performance of your models with some kind of cross-validation procedure using the training data.</p>",
      "votes": 5,
      "replies": [
        {
          "id": 1894507,
          "author_name": "jcerpent",
          "author_url": "",
          "post_date": "2022-08-11T14:44:43.287000",
          "content": "<p>Thank you for the useful reply!</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1894428,
      "author_name": "Pablo Larrosa",
      "author_url": "",
      "post_date": "2022-08-11T13:52:22.313000",
      "content": "<p>Thank Ryan for your answer! , now I understand why Leaderboard had one digit.</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1904158,
      "author_name": "Thush_Thusinthaka",
      "author_url": "",
      "post_date": "2022-08-18T02:26:00.513000",
      "content": "<p>Hi, <a href=\"https://www.kaggle.com/ryanholbrook\" target=\"_blank\">@ryanholbrook</a> , So by the end of the competition the test-Image in Public will get Obsolete ?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1898045,
      "author_name": "Pablo Larrosa",
      "author_url": "",
      "post_date": "2022-08-14T08:31:22.847000",
      "content": "<p>Hi, <a href=\"https://www.kaggle.com/ryanholbrook\" target=\"_blank\">@ryanholbrook</a> , by the end of the competition the test images are the same?.</p>\n<p>Thanks!</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1893716,
      "author_name": "Yannik",
      "author_url": "",
      "post_date": "2022-08-11T03:07:31.467000",
      "content": "<p>Can the 3% public test data actually reflect the performance of your model?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1894254,
          "author_name": "jcerpent",
          "author_url": "",
          "post_date": "2022-08-11T11:00:24.117000",
          "content": "<p>It's 7% actually, but still, you have a point. I think it's merely a rough indication.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1893434,
      "author_name": "Florin Lupu",
      "author_url": "",
      "post_date": "2022-08-10T19:40:40.777000",
      "content": "<p>gg good work man</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1892791,
      "author_name": "",
      "author_url": "",
      "post_date": "2022-08-10T10:34:11.803000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1894390": "Hey @pablolarrosa ,\n\nWe've limited the leaderboard digits and number of submissions to help prevent probing. As another commenter mentioned, the public test set is very small and I'd caution against relying on the public LB; it's probably not very meaningful in this competition. You'll likely have the most success estimating the performance of your models with some kind of cross-validation procedure using the training data.",
    "1888930": "Hi @ashleychow, I don't know if it's possible to add more digits to the leaderboard because there are so many positions and I can't distinguish what the real difference in score is.\n\nThanks in advance!",
    "1894428": "Thank Ryan for your answer! , now I understand why Leaderboard had one digit.",
    "1904158": "Hi, @ryanholbrook , So by the end of the competition the test-Image in Public will get Obsolete ?\n ",
    "1898045": "Hi, @ryanholbrook , by the end of the competition the test images are the same?.\n\nThanks!",
    "1893716": "Can the 3% public test data actually reflect the performance of your model?",
    "1893434": "gg good work man\n",
    "1892791": ""
  }
}