{
  "id": 442383,
  "title": "[SOLVED]problem with submission",
  "url": "/competitions/rsna-2023-abdominal-trauma-detection/discussion/442383",
  "author_name": "sagi or",
  "post_date": "2023-09-22T11:17:09.235000",
  "votes": 0,
  "comment_count": 12,
  "views": 0,
  "content": "<p>I am submitting the file and I have a submission.csv file but gives me an error on the file <br>\nI have all the 14 classes with all their probabilities for a given patient_id<br>\nCan some one help me?<br>\nI might think the the patient_id is float with idNum.0 is that a problem?<br>\nI am putting my example csv here, with the known test Data</p>",
  "messages": [
    {
      "id": 2451844,
      "postDate": "2023-09-22T20:40:13.240Z",
      "content": "<p>Have you account for the corrupt file in the hidden test set?<br>\nsee this post <a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/435815\" target=\"_blank\">https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/435815</a></p>\n<p>Most people circumvent this corrupt file by encasing their inference codes in a try-except block. Another option is to add logic to exclude the corrupted file. If you load the corrupted dcm file with pydicom, the notebook will throw an error.</p>",
      "rawMarkdown": "Have you account for the corrupt file in the hidden test set?\nsee this post https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/435815\n\nMost people circumvent this corrupt file by encasing their inference codes in a try-except block. Another option is to add logic to exclude the corrupted file. If you load the corrupted dcm file with pydicom, the notebook will throw an error.",
      "replies": [
        {
          "id": 2452411,
          "postDate": "2023-09-23T09:05:09.767Z",
          "content": "<p>no I didn't know about the corrupted file, I will try skipping it and update, thanks!</p>",
          "rawMarkdown": "no I didn't know about the corrupted file, I will try skipping it and update, thanks!",
          "replies": [
            {
              "id": 2453075,
              "postDate": "2023-09-23T19:30:05.167Z",
              "content": "<p>tried rapping the decoding func in a try except and it still didnt work :(</p>",
              "rawMarkdown": "tried rapping the decoding func in a try except and it still didnt work :("
            }
          ]
        }
      ]
    },
    {
      "id": 2451661,
      "postDate": "2023-09-22T17:00:24.630Z",
      "content": "<p>It looks like there is no problem in the submission file. Could you write what error you get when submitting?</p>",
      "rawMarkdown": "It looks like there is no problem in the submission file. Could you write what error you get when submitting?",
      "replies": [
        {
          "id": 2452417,
          "postDate": "2023-09-23T09:09:11.787Z",
          "content": "<p>Submission Scoring Error<br>\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips</p>\n<p>I also think that maybe the order of the patient id is reversed (from high to low, instead from low to high), is that causing a problem?</p>",
          "rawMarkdown": "Submission Scoring Error\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips\n\nI also think that maybe the order of the patient id is reversed (from high to low, instead from low to high), is that causing a problem?",
          "replies": [
            {
              "id": 2452430,
              "postDate": "2023-09-23T09:19:19.077Z",
              "content": "<p>Did you set <strong>index=False</strong> when creating the submission file? Maybe the problem is caused by the index. But you can also try to change the order.</p>\n<p>I hope you can solve the problem</p>",
              "rawMarkdown": "Did you set **index=False** when creating the submission file? Maybe the problem is caused by the index. But you can also try to change the order.\n\nI hope you can solve the problem",
              "votes": 1
            },
            {
              "id": 2453078,
              "postDate": "2023-09-23T19:31:47.037Z",
              "content": "<p>i did not created the file with pandas from a data frame, i am just writing into a csv file with the csv module</p>",
              "rawMarkdown": "i did not created the file with pandas from a data frame, i am just writing into a csv file with the csv module"
            },
            {
              "id": 2453773,
              "postDate": "2023-09-24T09:47:05.773Z",
              "content": "<p>I created the submission file using the pandas library. You can retype the last part of your code or try using a data frame.</p>\n<p>How did you create your submission file? The problem may not be caused by the way you created the submission file.</p>",
              "rawMarkdown": "I created the submission file using the pandas library. You can retype the last part of your code or try using a data frame.\n\nHow did you create your submission file? The problem may not be caused by the way you created the submission file.",
              "votes": 1
            },
            {
              "id": 2459402,
              "postDate": "2023-09-28T07:41:17.643Z",
              "content": "<p>i think the problem was the way i created, i tried with pandas an it worked! <br>\nthank you very much<br>\nalso i think i didn't create the pandas dataframe efficiently, any tips?</p>",
              "rawMarkdown": "i think the problem was the way i created, i tried with pandas an it worked! \nthank you very much\nalso i think i didn't create the pandas dataframe efficiently, any tips?\n "
            },
            {
              "id": 2459412,
              "postDate": "2023-09-28T07:48:59.407Z",
              "content": "<p>I'm glad I could help. What do you mean by efficiently? Can you describe the problem in detail so that I can help you?</p>",
              "rawMarkdown": "I'm glad I could help. What do you mean by efficiently? Can you describe the problem in detail so that I can help you?"
            },
            {
              "id": 2462267,
              "postDate": "2023-09-30T08:45:10.673Z",
              "content": "<p>Currently I am creating a dict of my preds, and I am just adding him to the results every time and It's a very slow proccess</p>",
              "rawMarkdown": "Currently I am creating a dict of my preds, and I am just adding him to the results every time and It's a very slow proccess\n"
            },
            {
              "id": 2463812,
              "postDate": "2023-10-01T15:27:39.293Z",
              "content": "<p>never mind, looked at the keras team infer and it helped me a lot, thanks anyway!</p>",
              "rawMarkdown": "never mind, looked at the keras team infer and it helped me a lot, thanks anyway!\n"
            }
          ]
        }
      ]
    },
    {
      "id": 2451191,
      "postDate": "2023-09-22T11:17:09.237Z",
      "content": "<p>I am submitting the file and I have a submission.csv file but gives me an error on the file <br>\nI have all the 14 classes with all their probabilities for a given patient_id<br>\nCan some one help me?<br>\nI might think the the patient_id is float with idNum.0 is that a problem?<br>\nI am putting my example csv here, with the known test Data</p>",
      "rawMarkdown": "I am submitting the file and I have a submission.csv file but gives me an error on the file \nI have all the 14 classes with all their probabilities for a given patient_id\nCan some one help me?\nI might think the the patient_id is float with idNum.0 is that a problem?\nI am putting my example csv here, with the known test Data"
    }
  ],
  "comments": [
    {
      "id": 2451844,
      "author_name": "Yee Ng",
      "author_url": "",
      "post_date": "2023-09-22T20:40:13.240000",
      "content": "<p>Have you account for the corrupt file in the hidden test set?<br>\nsee this post <a href=\"https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/435815\" target=\"_blank\">https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/435815</a></p>\n<p>Most people circumvent this corrupt file by encasing their inference codes in a try-except block. Another option is to add logic to exclude the corrupted file. If you load the corrupted dcm file with pydicom, the notebook will throw an error.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 2452411,
          "author_name": "sagi or",
          "author_url": "",
          "post_date": "2023-09-23T09:05:09.767000",
          "content": "<p>no I didn't know about the corrupted file, I will try skipping it and update, thanks!</p>",
          "votes": 0,
          "replies": [
            {
              "id": 2453075,
              "author_name": "sagi or",
              "author_url": "",
              "post_date": "2023-09-23T19:30:05.167000",
              "content": "<p>tried rapping the decoding func in a try except and it still didnt work :(</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2451661,
      "author_name": "Yunus Selim Aytekin",
      "author_url": "",
      "post_date": "2023-09-22T17:00:24.630000",
      "content": "<p>It looks like there is no problem in the submission file. Could you write what error you get when submitting?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 2452417,
          "author_name": "sagi or",
          "author_url": "",
          "post_date": "2023-09-23T09:09:11.787000",
          "content": "<p>Submission Scoring Error<br>\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips</p>\n<p>I also think that maybe the order of the patient id is reversed (from high to low, instead from low to high), is that causing a problem?</p>",
          "votes": 0,
          "replies": [
            {
              "id": 2452430,
              "author_name": "Yunus Selim Aytekin",
              "author_url": "",
              "post_date": "2023-09-23T09:19:19.077000",
              "content": "<p>Did you set <strong>index=False</strong> when creating the submission file? Maybe the problem is caused by the index. But you can also try to change the order.</p>\n<p>I hope you can solve the problem</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 2453078,
              "author_name": "sagi or",
              "author_url": "",
              "post_date": "2023-09-23T19:31:47.037000",
              "content": "<p>i did not created the file with pandas from a data frame, i am just writing into a csv file with the csv module</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2453773,
              "author_name": "Yunus Selim Aytekin",
              "author_url": "",
              "post_date": "2023-09-24T09:47:05.773000",
              "content": "<p>I created the submission file using the pandas library. You can retype the last part of your code or try using a data frame.</p>\n<p>How did you create your submission file? The problem may not be caused by the way you created the submission file.</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 2459402,
              "author_name": "sagi or",
              "author_url": "",
              "post_date": "2023-09-28T07:41:17.643000",
              "content": "<p>i think the problem was the way i created, i tried with pandas an it worked! <br>\nthank you very much<br>\nalso i think i didn't create the pandas dataframe efficiently, any tips?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2459412,
              "author_name": "Yunus Selim Aytekin",
              "author_url": "",
              "post_date": "2023-09-28T07:48:59.407000",
              "content": "<p>I'm glad I could help. What do you mean by efficiently? Can you describe the problem in detail so that I can help you?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2462267,
              "author_name": "sagi or",
              "author_url": "",
              "post_date": "2023-09-30T08:45:10.673000",
              "content": "<p>Currently I am creating a dict of my preds, and I am just adding him to the results every time and It's a very slow proccess</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2463812,
              "author_name": "sagi or",
              "author_url": "",
              "post_date": "2023-10-01T15:27:39.293000",
              "content": "<p>never mind, looked at the keras team infer and it helped me a lot, thanks anyway!</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2451844": "Have you account for the corrupt file in the hidden test set?\nsee this post https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/discussion/435815\n\nMost people circumvent this corrupt file by encasing their inference codes in a try-except block. Another option is to add logic to exclude the corrupted file. If you load the corrupted dcm file with pydicom, the notebook will throw an error.",
    "2451661": "It looks like there is no problem in the submission file. Could you write what error you get when submitting?",
    "2451191": "I am submitting the file and I have a submission.csv file but gives me an error on the file \nI have all the 14 classes with all their probabilities for a given patient_id\nCan some one help me?\nI might think the the patient_id is float with idNum.0 is that a problem?\nI am putting my example csv here, with the known test Data"
  }
}