{
  "id": 600658,
  "title": "Submission error after dataset update",
  "url": "/competitions/rsna-intracranial-aneurysm-detection/discussion/600658",
  "author_name": "Vadasz",
  "post_date": "2025-08-24T09:27:55.304000",
  "votes": 4,
  "comment_count": 11,
  "views": 0,
  "content": "<p>I resubmitted my notebook after updating the dataset. My submission finished with a \"notebook threw an exception\" error after a few minutes. The same notebook worked before the dataset update.</p>\n<p>Were there any changes that could have broken previously working notebooks?</p>",
  "messages": [
    {
      "id": 3274261,
      "postDate": "2025-08-24T13:10:17.910Z",
      "content": "<p>I encountered the same problem. notebook threw an exception after 3 minutes. I found that there is some problem in dicom files of the hidden testset, lack of SeriesInstanceUID, ImageOrientationPatient, ImagePositionPatient, InstanceNumber in dicom metadata. Is your code loading the dicom files and accessing these metadata?</p>",
      "rawMarkdown": "I encountered the same problem. notebook threw an exception after 3 minutes. I found that there is some problem in dicom files of the hidden testset, lack of SeriesInstanceUID, ImageOrientationPatient, ImagePositionPatient, InstanceNumber in dicom metadata. Is your code loading the dicom files and accessing these metadata?",
      "votes": 3,
      "replies": [
        {
          "id": 3274295,
          "postDate": "2025-08-24T14:43:02.430Z",
          "content": "<p>Yes, I use this metadata. How did you figure out that the testset has a metadata problem?</p>",
          "rawMarkdown": "Yes, I use this metadata. How did you figure out that the testset has a metadata problem?",
          "replies": [
            {
              "id": 3274307,
              "postDate": "2025-08-24T14:59:05.877Z",
              "content": "<p>I started submit yesterday. And I wasted 10 submissions to figure it out by commenting out my code step by step😭<br>\nIs this start to occur after data update?<br>\nI have @ the host. I don't think the test data should have that kind of problem.</p>\n<p>Here is my validation code which perform a check on each dicom file and remove the invalid ones. I applyed <code>assert len(dicoms) == 0</code> after the validation in the submission and that raised Exception<br>\n<a href=\"https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/596296#3274179\" target=\"_blank\">https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/596296#3274179</a></p>",
              "rawMarkdown": "I started submit yesterday. And I wasted 10 submissions to figure it out by commenting out my code step by step😭\nIs this start to occur after data update?\nI have @ the host. I don't think the test data should have that kind of problem.\n\nHere is my validation code which perform a check on each dicom file and remove the invalid ones. I applyed `assert len(dicoms) == 0` after the validation in the submission and that raised Exception\nhttps://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/596296#3274179",
              "votes": 3
            },
            {
              "id": 3274342,
              "postDate": "2025-08-24T16:03:33.433Z",
              "content": "<p><a href=\"https://www.kaggle.com/honglihang\" target=\"_blank\">@honglihang</a> <a href=\"https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/600396\" target=\"_blank\">https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/600396</a>   check this the host is working on this</p>",
              "rawMarkdown": "@honglihang https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/600396   check this the host is working on this",
              "votes": 2
            },
            {
              "id": 3274379,
              "postDate": "2025-08-24T16:37:12.750Z",
              "content": "<p>Thanks. I saw your post before. Since you succeeded in submitting so I thought this may be a different problem. Do you use the metadata I mentioned above during submission?</p>",
              "rawMarkdown": "Thanks. I saw your post before. Since you succeeded in submitting so I thought this may be a different problem. Do you use the metadata I mentioned above during submission?"
            },
            {
              "id": 3274476,
              "postDate": "2025-08-24T20:38:30.867Z",
              "content": "<blockquote>\n  <p>And I wasted 10 submissions to figure it out by commenting out my code step by step😭</p>\n</blockquote>\n<p>And here I was wondering how are you not at the top of the LB with 10 subs done 😄</p>",
              "rawMarkdown": ">And I wasted 10 submissions to figure it out by commenting out my code step by step😭\n\nAnd here I was wondering how are you not at the top of the LB with 10 subs done 😄"
            },
            {
              "id": 3274556,
              "postDate": "2025-08-25T02:35:04.143Z",
              "content": "<p><a href=\"https://www.kaggle.com/honglihang\" target=\"_blank\">@honglihang</a>, yes, I use those, but my submission runs for  1 hr, and I end up with  0.50 score. Mine was successful because I used try and except if any error, i fill up the predictions with 0.1</p>",
              "rawMarkdown": "@honglihang, yes, I use those, but my submission runs for  1 hr, and I end up with  0.50 score. Mine was successful because I used try and except if any error, i fill up the predictions with 0.1",
              "votes": 1
            },
            {
              "id": 3274559,
              "postDate": "2025-08-25T02:44:35.017Z",
              "content": "<p><a href=\"https://www.kaggle.com/arunodhayan\" target=\"_blank\">@arunodhayan</a> I have the same results as you. There are no errors, but all the results are 0.5 lb. It’s quite frustrating because I can’t submit my good ideas :)</p>",
              "rawMarkdown": "@arunodhayan I have the same results as you. There are no errors, but all the results are 0.5 lb. It’s quite frustrating because I can’t submit my good ideas :)",
              "votes": 1
            },
            {
              "id": 3274573,
              "postDate": "2025-08-25T03:22:48.640Z",
              "content": "<p>Thank you for your explanation! Then maybe we are facing the same issue. Hoping that the host will fix this problem.</p>",
              "rawMarkdown": "Thank you for your explanation! Then maybe we are facing the same issue. Hoping that the host will fix this problem.",
              "votes": 1
            },
            {
              "id": 3274586,
              "postDate": "2025-08-25T04:15:25.250Z",
              "content": "<p>My CV is at the top, maybe🤪</p>",
              "rawMarkdown": "My CV is at the top, maybe🤪"
            }
          ]
        }
      ]
    },
    {
      "id": 3274191,
      "postDate": "2025-08-24T09:27:55.303Z",
      "content": "<p>I resubmitted my notebook after updating the dataset. My submission finished with a \"notebook threw an exception\" error after a few minutes. The same notebook worked before the dataset update.</p>\n<p>Were there any changes that could have broken previously working notebooks?</p>",
      "rawMarkdown": "I resubmitted my notebook after updating the dataset. My submission finished with a \"notebook threw an exception\" error after a few minutes. The same notebook worked before the dataset update.\n\nWere there any changes that could have broken previously working notebooks?",
      "votes": 4
    },
    {
      "id": 3274202,
      "postDate": "2025-08-24T10:03:06.070Z",
      "content": "<p>Submission system is currently broken. Just wait until they announce fixing.</p>",
      "rawMarkdown": "Submission system is currently broken. Just wait until they announce fixing.",
      "votes": 1
    }
  ],
  "comments": [
    {
      "id": 3274261,
      "author_name": "RihanPiggy",
      "author_url": "",
      "post_date": "2025-08-24T13:10:17.910000",
      "content": "<p>I encountered the same problem. notebook threw an exception after 3 minutes. I found that there is some problem in dicom files of the hidden testset, lack of SeriesInstanceUID, ImageOrientationPatient, ImagePositionPatient, InstanceNumber in dicom metadata. Is your code loading the dicom files and accessing these metadata?</p>",
      "votes": 3,
      "replies": [
        {
          "id": 3274295,
          "author_name": "Vadasz",
          "author_url": "",
          "post_date": "2025-08-24T14:43:02.430000",
          "content": "<p>Yes, I use this metadata. How did you figure out that the testset has a metadata problem?</p>",
          "votes": 0,
          "replies": [
            {
              "id": 3274307,
              "author_name": "RihanPiggy",
              "author_url": "",
              "post_date": "2025-08-24T14:59:05.877000",
              "content": "<p>I started submit yesterday. And I wasted 10 submissions to figure it out by commenting out my code step by step😭<br>\nIs this start to occur after data update?<br>\nI have @ the host. I don't think the test data should have that kind of problem.</p>\n<p>Here is my validation code which perform a check on each dicom file and remove the invalid ones. I applyed <code>assert len(dicoms) == 0</code> after the validation in the submission and that raised Exception<br>\n<a href=\"https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/596296#3274179\" target=\"_blank\">https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/596296#3274179</a></p>",
              "votes": 3,
              "replies": []
            },
            {
              "id": 3274342,
              "author_name": "Arunodhayan",
              "author_url": "",
              "post_date": "2025-08-24T16:03:33.433000",
              "content": "<p><a href=\"https://www.kaggle.com/honglihang\" target=\"_blank\">@honglihang</a> <a href=\"https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/600396\" target=\"_blank\">https://www.kaggle.com/competitions/rsna-intracranial-aneurysm-detection/discussion/600396</a>   check this the host is working on this</p>",
              "votes": 2,
              "replies": []
            },
            {
              "id": 3274379,
              "author_name": "RihanPiggy",
              "author_url": "",
              "post_date": "2025-08-24T16:37:12.750000",
              "content": "<p>Thanks. I saw your post before. Since you succeeded in submitting so I thought this may be a different problem. Do you use the metadata I mentioned above during submission?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3274476,
              "author_name": "Harshit Sheoran",
              "author_url": "",
              "post_date": "2025-08-24T20:38:30.867000",
              "content": "<blockquote>\n  <p>And I wasted 10 submissions to figure it out by commenting out my code step by step😭</p>\n</blockquote>\n<p>And here I was wondering how are you not at the top of the LB with 10 subs done 😄</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3274556,
              "author_name": "Arunodhayan",
              "author_url": "",
              "post_date": "2025-08-25T02:35:04.143000",
              "content": "<p><a href=\"https://www.kaggle.com/honglihang\" target=\"_blank\">@honglihang</a>, yes, I use those, but my submission runs for  1 hr, and I end up with  0.50 score. Mine was successful because I used try and except if any error, i fill up the predictions with 0.1</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3274559,
              "author_name": "Tom",
              "author_url": "",
              "post_date": "2025-08-25T02:44:35.017000",
              "content": "<p><a href=\"https://www.kaggle.com/arunodhayan\" target=\"_blank\">@arunodhayan</a> I have the same results as you. There are no errors, but all the results are 0.5 lb. It’s quite frustrating because I can’t submit my good ideas :)</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3274573,
              "author_name": "RihanPiggy",
              "author_url": "",
              "post_date": "2025-08-25T03:22:48.640000",
              "content": "<p>Thank you for your explanation! Then maybe we are facing the same issue. Hoping that the host will fix this problem.</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3274586,
              "author_name": "RihanPiggy",
              "author_url": "",
              "post_date": "2025-08-25T04:15:25.250000",
              "content": "<p>My CV is at the top, maybe🤪</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3274202,
      "author_name": "Tom",
      "author_url": "",
      "post_date": "2025-08-24T10:03:06.070000",
      "content": "<p>Submission system is currently broken. Just wait until they announce fixing.</p>",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3274261": "I encountered the same problem. notebook threw an exception after 3 minutes. I found that there is some problem in dicom files of the hidden testset, lack of SeriesInstanceUID, ImageOrientationPatient, ImagePositionPatient, InstanceNumber in dicom metadata. Is your code loading the dicom files and accessing these metadata?",
    "3274191": "I resubmitted my notebook after updating the dataset. My submission finished with a \"notebook threw an exception\" error after a few minutes. The same notebook worked before the dataset update.\n\nWere there any changes that could have broken previously working notebooks?",
    "3274202": "Submission system is currently broken. Just wait until they announce fixing."
  }
}