{
  "id": 447151,
  "title": "How to prepare data?",
  "url": "/competitions/UBC-OCEAN/discussion/447151",
  "author_name": "Samuel Abramov",
  "post_date": "2023-10-14T14:11:19.522000",
  "votes": 3,
  "comment_count": 0,
  "views": 0,
  "content": "<p>On my local machine I prepared the dataset with Step 1. convert all images to a smaller size and then did my staff. After I copy pasted the code into my notebook and started it, I faced a problem. Step 1 never finish without any errors, for some reason the notebook turns off after ~1 hour. I think the entire convert process will take 8hours or so…</p>\n<p>Second approach,</p>\n<p>Converting on the fly. Here I faced the problem that gpu has not enough memory.</p>\n<p>Question. How I can prepare data for e.g. feature extraction? With all of this limitations… Maybe someone share a notebook</p>",
  "messages": [
    {
      "id": 2481917,
      "postDate": "2023-10-14T14:11:19.523Z",
      "content": "<p>On my local machine I prepared the dataset with Step 1. convert all images to a smaller size and then did my staff. After I copy pasted the code into my notebook and started it, I faced a problem. Step 1 never finish without any errors, for some reason the notebook turns off after ~1 hour. I think the entire convert process will take 8hours or so…</p>\n<p>Second approach,</p>\n<p>Converting on the fly. Here I faced the problem that gpu has not enough memory.</p>\n<p>Question. How I can prepare data for e.g. feature extraction? With all of this limitations… Maybe someone share a notebook</p>",
      "rawMarkdown": "On my local machine I prepared the dataset with Step 1. convert all images to a smaller size and then did my staff. After I copy pasted the code into my notebook and started it, I faced a problem. Step 1 never finish without any errors, for some reason the notebook turns off after ~1 hour. I think the entire convert process will take 8hours or so...\n\nSecond approach,\n\nConverting on the fly. Here I faced the problem that gpu has not enough memory.\n\nQuestion. How I can prepare data for e.g. feature extraction? With all of this limitations... Maybe someone share a notebook",
      "votes": 3
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2481917": "On my local machine I prepared the dataset with Step 1. convert all images to a smaller size and then did my staff. After I copy pasted the code into my notebook and started it, I faced a problem. Step 1 never finish without any errors, for some reason the notebook turns off after ~1 hour. I think the entire convert process will take 8hours or so...\n\nSecond approach,\n\nConverting on the fly. Here I faced the problem that gpu has not enough memory.\n\nQuestion. How I can prepare data for e.g. feature extraction? With all of this limitations... Maybe someone share a notebook"
  }
}