{
  "id": 676172,
  "title": "Submission Fail with \"Submission Scoring Error\"",
  "url": "/competitions/stanford-rna-3d-folding-2/discussion/676172",
  "author_name": "Farhad Hormozdiari",
  "post_date": "2026-02-23T18:13:50.138000",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I have a notebook that runs in less than 16 minutes on the provided test datasets. However, when I submit it to Kaggle for evaluation, it runs for over 4 hours before returning a 'Submission Scoring Error.' I am not sure what the error is or why it's happening. Is there any way to debug this? I have already verified that I am using the correct output format and the right number of rows for the provided test data.</p>",
  "messages": [
    {
      "id": 3410825,
      "postDate": "2026-02-23T18:13:50.140Z",
      "content": "<p>I have a notebook that runs in less than 16 minutes on the provided test datasets. However, when I submit it to Kaggle for evaluation, it runs for over 4 hours before returning a 'Submission Scoring Error.' I am not sure what the error is or why it's happening. Is there any way to debug this? I have already verified that I am using the correct output format and the right number of rows for the provided test data.</p>",
      "rawMarkdown": "I have a notebook that runs in less than 16 minutes on the provided test datasets. However, when I submit it to Kaggle for evaluation, it runs for over 4 hours before returning a 'Submission Scoring Error.' I am not sure what the error is or why it's happening. Is there any way to debug this? I have already verified that I am using the correct output format and the right number of rows for the provided test data.",
      "votes": 1
    },
    {
      "id": 3426949,
      "postDate": "2026-03-23T14:25:04.640Z",
      "content": "<p>I cant really solved the issue but I would check:</p>\n<p>1) NaN Values: Ensure there are no NaNs in the output, as Gabor mentioned.</p>\n<p>2) Memory Leaks: Verify there is no memory leakage. The hidden test set may contain longer sequences that could trigger an Out of Memory (OOM) error.</p>\n<p>3) Timeouts: Longer sequences in the hidden set could also cause the code to exceed the time limit.\"</p>",
      "rawMarkdown": "I cant really solved the issue but I would check:\n\n1) NaN Values: Ensure there are no NaNs in the output, as Gabor mentioned.\n\n2) Memory Leaks: Verify there is no memory leakage. The hidden test set may contain longer sequences that could trigger an Out of Memory (OOM) error.\n\n3) Timeouts: Longer sequences in the hidden set could also cause the code to exceed the time limit.\""
    },
    {
      "id": 3426547,
      "postDate": "2026-03-22T19:40:26.250Z",
      "content": "<p>Also make sure you do not have NaN values. As I recall, they caused me a few submission scoring errors.</p>",
      "rawMarkdown": "Also make sure you do not have NaN values. As I recall, they caused me a few submission scoring errors."
    },
    {
      "id": 3426408,
      "postDate": "2026-03-22T14:37:20.767Z",
      "content": "<p>Hello, May I ask if you have resolved it? Thanks.</p>",
      "rawMarkdown": "Hello, May I ask if you have resolved it? Thanks."
    }
  ],
  "comments": [
    {
      "id": 3426949,
      "author_name": "Farhad Hormozdiari",
      "author_url": "",
      "post_date": "2026-03-23T14:25:04.640000",
      "content": "<p>I cant really solved the issue but I would check:</p>\n<p>1) NaN Values: Ensure there are no NaNs in the output, as Gabor mentioned.</p>\n<p>2) Memory Leaks: Verify there is no memory leakage. The hidden test set may contain longer sequences that could trigger an Out of Memory (OOM) error.</p>\n<p>3) Timeouts: Longer sequences in the hidden set could also cause the code to exceed the time limit.\"</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3426547,
      "author_name": "Gabor Balazs",
      "author_url": "",
      "post_date": "2026-03-22T19:40:26.250000",
      "content": "<p>Also make sure you do not have NaN values. As I recall, they caused me a few submission scoring errors.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3426408,
      "author_name": "Jiacheng Ma",
      "author_url": "",
      "post_date": "2026-03-22T14:37:20.767000",
      "content": "<p>Hello, May I ask if you have resolved it? Thanks.</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3410825": "I have a notebook that runs in less than 16 minutes on the provided test datasets. However, when I submit it to Kaggle for evaluation, it runs for over 4 hours before returning a 'Submission Scoring Error.' I am not sure what the error is or why it's happening. Is there any way to debug this? I have already verified that I am using the correct output format and the right number of rows for the provided test data.",
    "3426949": "I cant really solved the issue but I would check:\n\n1) NaN Values: Ensure there are no NaNs in the output, as Gabor mentioned.\n\n2) Memory Leaks: Verify there is no memory leakage. The hidden test set may contain longer sequences that could trigger an Out of Memory (OOM) error.\n\n3) Timeouts: Longer sequences in the hidden set could also cause the code to exceed the time limit.\"",
    "3426547": "Also make sure you do not have NaN values. As I recall, they caused me a few submission scoring errors.",
    "3426408": "Hello, May I ask if you have resolved it? Thanks."
  }
}