{
  "id": 602885,
  "title": "An Update on Submission Scoring",
  "url": "/competitions/rsna-intracranial-aneurysm-detection/discussion/602885",
  "author_name": "Ryan Holbrook",
  "post_date": "2025-08-30T11:10:54.234000",
  "votes": 20,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Hi everyone,</p>\n<p>I have begun an update of the hidden evaluation set. We tested the evaluation system much more extensively this time, and it should fix the issues we were having with the previous update. It should be live in a few hours.</p>\n<p>I will be rescoring all submissions made between 08/20 and today, 08/30. This may take a few days to complete, so expect new scores to be posted sometime this coming week.</p>\n<p>We apologize again for the disruption. The size of the dataset has challenged our systems, but we are committed to resolving all issues as fairly and quickly as we can.</p>\n<p>We're proud to be a platform for important competitions like this one, and we can't wait to see how the community progresses from here. Please let us know about any other issues if they arise, or any questions or concerns.</p>",
  "messages": [
    {
      "id": 3278689,
      "postDate": "2025-08-30T11:10:54.233Z",
      "content": "<p>Hi everyone,</p>\n<p>I have begun an update of the hidden evaluation set. We tested the evaluation system much more extensively this time, and it should fix the issues we were having with the previous update. It should be live in a few hours.</p>\n<p>I will be rescoring all submissions made between 08/20 and today, 08/30. This may take a few days to complete, so expect new scores to be posted sometime this coming week.</p>\n<p>We apologize again for the disruption. The size of the dataset has challenged our systems, but we are committed to resolving all issues as fairly and quickly as we can.</p>\n<p>We're proud to be a platform for important competitions like this one, and we can't wait to see how the community progresses from here. Please let us know about any other issues if they arise, or any questions or concerns.</p>",
      "rawMarkdown": "Hi everyone,\n\nI have begun an update of the hidden evaluation set. We tested the evaluation system much more extensively this time, and it should fix the issues we were having with the previous update. It should be live in a few hours.\n\nI will be rescoring all submissions made between 08/20 and today, 08/30. This may take a few days to complete, so expect new scores to be posted sometime this coming week.\n\nWe apologize again for the disruption. The size of the dataset has challenged our systems, but we are committed to resolving all issues as fairly and quickly as we can.\n\nWe're proud to be a platform for important competitions like this one, and we can't wait to see how the community progresses from here. Please let us know about any other issues if they arise, or any questions or concerns.",
      "votes": 20
    },
    {
      "id": 3295285,
      "postDate": "2025-09-28T10:04:13.857Z",
      "content": "<p>Could you please tell me how long the evaluation will take? It's been 3 hours and it still shows 'scoring'. Is there a problem with the submitted file? But there isn't any error message either.</p>",
      "rawMarkdown": "Could you please tell me how long the evaluation will take? It's been 3 hours and it still shows 'scoring'. Is there a problem with the submitted file? But there isn't any error message either.",
      "replies": [
        {
          "id": 3295506,
          "postDate": "2025-09-29T01:04:18.340Z",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/yiyanghu\" target=\"_blank\">@yiyanghu</a>, just loading the dicoms for me takes &gt;4hrs.</p>",
          "rawMarkdown": "Hi @yiyanghu, just loading the dicoms for me takes >4hrs.",
          "votes": 1,
          "replies": [
            {
              "id": 3299662,
              "postDate": "2025-10-08T14:49:43.527Z",
              "content": "<p>\"Do I need to select a GPU when submitting predictions? Will it count toward the free 30 hours? Or will the inference automatically use a GPU? Approximately how long would it take if I use only the CPU for inference?Where can I see how long the inference took, besides checking in 'View active events'?\"</p>",
              "rawMarkdown": "\"Do I need to select a GPU when submitting predictions? Will it count toward the free 30 hours? Or will the inference automatically use a GPU? Approximately how long would it take if I use only the CPU for inference?Where can I see how long the inference took, besides checking in 'View active events'?\"\n\n"
            }
          ]
        }
      ]
    },
    {
      "id": 3278913,
      "postDate": "2025-08-30T17:31:01.360Z",
      "content": "<p>Thanks! Will there be an anounce after upload finished?</p>",
      "rawMarkdown": "Thanks! Will there be an anounce after upload finished?",
      "votes": 1
    },
    {
      "id": 3278800,
      "postDate": "2025-08-30T14:30:56.930Z",
      "content": "<p>Really thank to kaggle staff.</p>",
      "rawMarkdown": "Really thank to kaggle staff.",
      "votes": 1
    }
  ],
  "comments": [
    {
      "id": 3295285,
      "author_name": "Yiyang_Hu",
      "author_url": "",
      "post_date": "2025-09-28T10:04:13.857000",
      "content": "<p>Could you please tell me how long the evaluation will take? It's been 3 hours and it still shows 'scoring'. Is there a problem with the submitted file? But there isn't any error message either.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3295506,
          "author_name": "Bartley",
          "author_url": "",
          "post_date": "2025-09-29T01:04:18.340000",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/yiyanghu\" target=\"_blank\">@yiyanghu</a>, just loading the dicoms for me takes &gt;4hrs.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3299662,
              "author_name": "Yiyang_Hu",
              "author_url": "",
              "post_date": "2025-10-08T14:49:43.527000",
              "content": "<p>\"Do I need to select a GPU when submitting predictions? Will it count toward the free 30 hours? Or will the inference automatically use a GPU? Approximately how long would it take if I use only the CPU for inference?Where can I see how long the inference took, besides checking in 'View active events'?\"</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3278913,
      "author_name": "RihanPiggy",
      "author_url": "",
      "post_date": "2025-08-30T17:31:01.360000",
      "content": "<p>Thanks! Will there be an anounce after upload finished?</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 3278800,
      "author_name": "Tom",
      "author_url": "",
      "post_date": "2025-08-30T14:30:56.930000",
      "content": "<p>Really thank to kaggle staff.</p>",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3278689": "Hi everyone,\n\nI have begun an update of the hidden evaluation set. We tested the evaluation system much more extensively this time, and it should fix the issues we were having with the previous update. It should be live in a few hours.\n\nI will be rescoring all submissions made between 08/20 and today, 08/30. This may take a few days to complete, so expect new scores to be posted sometime this coming week.\n\nWe apologize again for the disruption. The size of the dataset has challenged our systems, but we are committed to resolving all issues as fairly and quickly as we can.\n\nWe're proud to be a platform for important competitions like this one, and we can't wait to see how the community progresses from here. Please let us know about any other issues if they arise, or any questions or concerns.",
    "3295285": "Could you please tell me how long the evaluation will take? It's been 3 hours and it still shows 'scoring'. Is there a problem with the submitted file? But there isn't any error message either.",
    "3278913": "Thanks! Will there be an anounce after upload finished?",
    "3278800": "Really thank to kaggle staff."
  }
}