{
  "id": 385042,
  "title": "Dataset Upload Error",
  "url": "/competitions/rsna-breast-cancer-detection/discussion/385042",
  "author_name": "FlaviuPaul",
  "post_date": "2023-02-10T18:30:54.960000",
  "votes": 3,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I wanted to create a png dataset with 1536x768 and it has 24GB. I've upload it using the web interface, and after a few hours, I got the prompt that the dataset is created successfully. When I try to use it is 404, looking at it on the Download button it has 0 bytes, while on the file explorer it looks like is complete.</p>\n<p>Any advice will be appreciated! </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F994574%2F8ab2e0959b84b8f5c92ce4c31603c782%2FKaggleDatasetError.PNG?generation=1676053617807671&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": 2138391,
      "postDate": "2023-02-10T18:30:54.960Z",
      "content": "<p>I wanted to create a png dataset with 1536x768 and it has 24GB. I've upload it using the web interface, and after a few hours, I got the prompt that the dataset is created successfully. When I try to use it is 404, looking at it on the Download button it has 0 bytes, while on the file explorer it looks like is complete.</p>\n<p>Any advice will be appreciated! </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F994574%2F8ab2e0959b84b8f5c92ce4c31603c782%2FKaggleDatasetError.PNG?generation=1676053617807671&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "I wanted to create a png dataset with 1536x768 and it has 24GB. I've upload it using the web interface, and after a few hours, I got the prompt that the dataset is created successfully. When I try to use it is 404, looking at it on the Download button it has 0 bytes, while on the file explorer it looks like is complete.\n\nAny advice will be appreciated! \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F994574%2F8ab2e0959b84b8f5c92ce4c31603c782%2FKaggleDatasetError.PNG?generation=1676053617807671&alt=media)",
      "votes": 3
    },
    {
      "id": 2138438,
      "postDate": "2023-02-10T19:02:29.753Z",
      "content": "<p>I had the same issue. I was going to make a support post about this issue since it seems like a site problem, maybe with a large dataset. But if you wait some hours--I checked about after a day--it'll hopefully be processed and available to download. I am guessing this is due to a large number of small files (we have 50k+ files in the training dataset) Kaggle maybe cannot process them fast enough or the time it takes to process isn't accounted for in the original upload processing time. I am not sure but check back in some time and see if you can download it.</p>",
      "rawMarkdown": "I had the same issue. I was going to make a support post about this issue since it seems like a site problem, maybe with a large dataset. But if you wait some hours--I checked about after a day--it'll hopefully be processed and available to download. I am guessing this is due to a large number of small files (we have 50k+ files in the training dataset) Kaggle maybe cannot process them fast enough or the time it takes to process isn't accounted for in the original upload processing time. I am not sure but check back in some time and see if you can download it.",
      "votes": 1,
      "replies": [
        {
          "id": 2138449,
          "postDate": "2023-02-10T19:15:35.317Z",
          "content": "<p>Thank you :) I will retry tomorrow. Hopefully, I will see some progress by moving from jpg to png</p>",
          "rawMarkdown": "Thank you :) I will retry tomorrow. Hopefully, I will see some progress by moving from jpg to png"
        }
      ]
    },
    {
      "id": 2139611,
      "postDate": "2023-02-10T23:02:26.197Z",
      "content": "<p>I had <a href=\"https://www.kaggle.com/discussions/product-feedback/385024#2138306\" target=\"_blank\">raised issue</a> for this same thing today - <br>\nand yes it takes some time for us to be able to download. </p>",
      "rawMarkdown": "I had [raised issue](https://www.kaggle.com/discussions/product-feedback/385024#2138306) for this same thing today - \nand yes it takes some time for us to be able to download. ",
      "votes": 2,
      "replies": [
        {
          "id": 2139978,
          "postDate": "2023-02-11T10:38:02.727Z",
          "content": "<p>I was able to use it after a couple of hours from the message saying that dataset was created successfully</p>",
          "rawMarkdown": "I was able to use it after a couple of hours from the message saying that dataset was created successfully"
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2138438,
      "author_name": "outwrest",
      "author_url": "",
      "post_date": "2023-02-10T19:02:29.753000",
      "content": "<p>I had the same issue. I was going to make a support post about this issue since it seems like a site problem, maybe with a large dataset. But if you wait some hours--I checked about after a day--it'll hopefully be processed and available to download. I am guessing this is due to a large number of small files (we have 50k+ files in the training dataset) Kaggle maybe cannot process them fast enough or the time it takes to process isn't accounted for in the original upload processing time. I am not sure but check back in some time and see if you can download it.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 2138449,
          "author_name": "FlaviuPaul",
          "author_url": "",
          "post_date": "2023-02-10T19:15:35.317000",
          "content": "<p>Thank you :) I will retry tomorrow. Hopefully, I will see some progress by moving from jpg to png</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 2139611,
      "author_name": "RB",
      "author_url": "",
      "post_date": "2023-02-10T23:02:26.197000",
      "content": "<p>I had <a href=\"https://www.kaggle.com/discussions/product-feedback/385024#2138306\" target=\"_blank\">raised issue</a> for this same thing today - <br>\nand yes it takes some time for us to be able to download. </p>",
      "votes": 2,
      "replies": [
        {
          "id": 2139978,
          "author_name": "FlaviuPaul",
          "author_url": "",
          "post_date": "2023-02-11T10:38:02.727000",
          "content": "<p>I was able to use it after a couple of hours from the message saying that dataset was created successfully</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2138391": "I wanted to create a png dataset with 1536x768 and it has 24GB. I've upload it using the web interface, and after a few hours, I got the prompt that the dataset is created successfully. When I try to use it is 404, looking at it on the Download button it has 0 bytes, while on the file explorer it looks like is complete.\n\nAny advice will be appreciated! \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F994574%2F8ab2e0959b84b8f5c92ce4c31603c782%2FKaggleDatasetError.PNG?generation=1676053617807671&alt=media)",
    "2138438": "I had the same issue. I was going to make a support post about this issue since it seems like a site problem, maybe with a large dataset. But if you wait some hours--I checked about after a day--it'll hopefully be processed and available to download. I am guessing this is due to a large number of small files (we have 50k+ files in the training dataset) Kaggle maybe cannot process them fast enough or the time it takes to process isn't accounted for in the original upload processing time. I am not sure but check back in some time and see if you can download it.",
    "2139611": "I had [raised issue](https://www.kaggle.com/discussions/product-feedback/385024#2138306) for this same thing today - \nand yes it takes some time for us to be able to download. "
  }
}