{
  "id": 554844,
  "title": "Downloading or accessing the data",
  "url": "/competitions/UBC-OCEAN/discussion/554844",
  "author_name": "NitinKumar",
  "post_date": "2025-01-03T15:54:30.207000",
  "votes": 0,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I am a newbie to this competition and I am trying to download the competition dataset to my system. However, it is huge and my primary hard disk is small (256 GB) and only secondary disk can be used to download the file (2 TB). </p>\n<p>However, when I tried using Kaggle API with python to download the data, it is not downloading more than 165 GB. </p>\n<p>I am wondering how others have accessed the data?  Looking at the code of others, it looks like they too downloaded the files to the machine. Any advice / recommendation? </p>\n<p>Thanks. </p>",
  "messages": [
    {
      "id": 3087555,
      "postDate": "2025-01-03T15:54:30.207Z",
      "content": "<p>I am a newbie to this competition and I am trying to download the competition dataset to my system. However, it is huge and my primary hard disk is small (256 GB) and only secondary disk can be used to download the file (2 TB). </p>\n<p>However, when I tried using Kaggle API with python to download the data, it is not downloading more than 165 GB. </p>\n<p>I am wondering how others have accessed the data?  Looking at the code of others, it looks like they too downloaded the files to the machine. Any advice / recommendation? </p>\n<p>Thanks. </p>",
      "rawMarkdown": "I am a newbie to this competition and I am trying to download the competition dataset to my system. However, it is huge and my primary hard disk is small (256 GB) and only secondary disk can be used to download the file (2 TB). \n\nHowever, when I tried using Kaggle API with python to download the data, it is not downloading more than 165 GB. \n\nI am wondering how others have accessed the data?  Looking at the code of others, it looks like they too downloaded the files to the machine. Any advice / recommendation? \n\nThanks. "
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "3087555": "I am a newbie to this competition and I am trying to download the competition dataset to my system. However, it is huge and my primary hard disk is small (256 GB) and only secondary disk can be used to download the file (2 TB). \n\nHowever, when I tried using Kaggle API with python to download the data, it is not downloading more than 165 GB. \n\nI am wondering how others have accessed the data?  Looking at the code of others, it looks like they too downloaded the files to the machine. Any advice / recommendation? \n\nThanks. "
  }
}