{
  "id": 461691,
  "title": "How to Move Data to Storage Bucket with GCloud CLI (ask & answer)",
  "url": "/competitions/UBC-OCEAN/discussion/461691",
  "author_name": "Todd Gardiner",
  "post_date": "2023-12-15T22:00:34.857000",
  "votes": 1,
  "comment_count": 0,
  "views": 0,
  "content": "<p>The images for this competition are not small. To make a pipeline the preprocessing needs to be done first. Needed more RAM and HDD to do what I wanted to try. So, I needed to get the images out to a Google Bucket. I looked for an answer across Kaggle first.  The results were dated, so I wrote a new one and am sharing the notebook.</p>\n<p><a href=\"https://www.kaggle.com/toddgardiner/google-cloud-storage-buckets-w-gcloud-cli\" target=\"_blank\">https://www.kaggle.com/toddgardiner/google-cloud-storage-buckets-w-gcloud-cli</a><br>\nHopefully this helps someone else.<br>\nEnjoy.</p>\n<p>(Please respect the competition sponsor and keep the images private until their paper is published)</p>",
  "messages": [
    {
      "id": 2562995,
      "postDate": "2023-12-15T22:00:34.857Z",
      "content": "<p>The images for this competition are not small. To make a pipeline the preprocessing needs to be done first. Needed more RAM and HDD to do what I wanted to try. So, I needed to get the images out to a Google Bucket. I looked for an answer across Kaggle first.  The results were dated, so I wrote a new one and am sharing the notebook.</p>\n<p><a href=\"https://www.kaggle.com/toddgardiner/google-cloud-storage-buckets-w-gcloud-cli\" target=\"_blank\">https://www.kaggle.com/toddgardiner/google-cloud-storage-buckets-w-gcloud-cli</a><br>\nHopefully this helps someone else.<br>\nEnjoy.</p>\n<p>(Please respect the competition sponsor and keep the images private until their paper is published)</p>",
      "rawMarkdown": "The images for this competition are not small. To make a pipeline the preprocessing needs to be done first. Needed more RAM and HDD to do what I wanted to try. So, I needed to get the images out to a Google Bucket. I looked for an answer across Kaggle first.  The results were dated, so I wrote a new one and am sharing the notebook.\n\nhttps://www.kaggle.com/toddgardiner/google-cloud-storage-buckets-w-gcloud-cli\nHopefully this helps someone else.\nEnjoy.\n\n(Please respect the competition sponsor and keep the images private until their paper is published)",
      "votes": 1
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2562995": "The images for this competition are not small. To make a pipeline the preprocessing needs to be done first. Needed more RAM and HDD to do what I wanted to try. So, I needed to get the images out to a Google Bucket. I looked for an answer across Kaggle first.  The results were dated, so I wrote a new one and am sharing the notebook.\n\nhttps://www.kaggle.com/toddgardiner/google-cloud-storage-buckets-w-gcloud-cli\nHopefully this helps someone else.\nEnjoy.\n\n(Please respect the competition sponsor and keep the images private until their paper is published)"
  }
}