I am very new to Kaggle and overall Deep learning. Can someone help with importing kaggle datasets onto Colab without downloading it in local system? Is it even possible? e.g. I want to train my network of STRIP-AI on Colab but the dataset is around 350GB.. so what to do?
", "messages": [ { "id": 1913698, "postDate": "2022-08-25T13:00:20.270Z", "content": "Would my Discussion be helpful?
\nhttps://www.kaggle.com/competitions/mayo-clinic-strip-ai/discussion/343470
", "rawMarkdown": "Would my Discussion be helpful?\n\nhttps://www.kaggle.com/competitions/mayo-clinic-strip-ai/discussion/343470", "votes": 2 }, { "id": 1910554, "postDate": "2022-08-23T14:04:51.823Z", "content": "I presume the below links will help you solve the problem-
\nYou need to create an API token in your Kaggle profile and use it as a bridge between colab and Kaggle.
", "rawMarkdown": "I presume the below links will help you solve the problem-\n1. https://www.geeksforgeeks.org/how-to-import-kaggle-datasets-directly-into-google-colab/#:~:text=Method%202%3A%20By%20easily%20downloading,folder%20to%20Google%20Colab%20Notebook.\n2. https://www.analyticsvidhya.com/blog/2021/06/how-to-load-kaggle-datasets-directly-into-google-colab/\n3. https://www.kaggle.com/general/74235\n\nYou need to create an API token in your Kaggle profile and use it as a bridge between colab and Kaggle. ", "votes": 2, "replies": [ { "id": 1911379, "postDate": "2022-08-24T04:11:07.487Z", "content": "Thanks Ravi.
", "rawMarkdown": "Thanks Ravi." }, { "id": 1911731, "postDate": "2022-08-24T09:15:17.890Z", "content": "Hi, I am now able to download the data but again there is an issue.. as the dataset is 350GB ..Colab is throwing an error saying the space is full..what to do?
", "rawMarkdown": "Hi, I am now able to download the data but again there is an issue.. as the dataset is 350GB ..Colab is throwing an error saying the space is full..what to do? " } ] }, { "id": 1910083, "postDate": "2022-08-23T06:47:43.863Z", "content": "I am very new to Kaggle and overall Deep learning. Can someone help with importing kaggle datasets onto Colab without downloading it in local system? Is it even possible? e.g. I want to train my network of STRIP-AI on Colab but the dataset is around 350GB.. so what to do?
", "rawMarkdown": "I am very new to Kaggle and overall Deep learning. Can someone help with importing kaggle datasets onto Colab without downloading it in local system? Is it even possible? e.g. I want to train my network of STRIP-AI on Colab but the dataset is around 350GB.. so what to do?", "votes": 2 }, { "id": 1912308, "postDate": "2022-08-24T16:32:10.763Z", "content": "I bought a 1000 GB for colab(Google drive) for this competition. Try to mount google drive first. Then download it and save in google drive.
", "rawMarkdown": "I bought a 1000 GB for colab(Google drive) for this competition. Try to mount google drive first. Then download it and save in google drive. ", "replies": [ { "id": 1927955, "postDate": "2022-09-06T05:49:17.197Z", "content": "I'll restate this so I am sure I understand:
\nIs this correct?
", "rawMarkdown": "I'll restate this so I am sure I understand:\n1. Buy extra space on Google Drive... like 1000GB\n2. Download dataset locally, then upload to drive\n3. Mount drive to colab\n\nIs this correct?" } ] } ], "comments": [ { "id": 1913698, "author_name": "min fuka", "author_url": "", "post_date": "2022-08-25T13:00:20.270000", "content": "Would my Discussion be helpful?
\nhttps://www.kaggle.com/competitions/mayo-clinic-strip-ai/discussion/343470
", "votes": 2, "replies": [] }, { "id": 1910554, "author_name": "Ravi Ramakrishnan", "author_url": "", "post_date": "2022-08-23T14:04:51.823000", "content": "I presume the below links will help you solve the problem-
\nYou need to create an API token in your Kaggle profile and use it as a bridge between colab and Kaggle.
", "votes": 2, "replies": [ { "id": 1911379, "author_name": "Shruti Marathe", "author_url": "", "post_date": "2022-08-24T04:11:07.487000", "content": "Thanks Ravi.
", "votes": 0, "replies": [] }, { "id": 1911731, "author_name": "Shruti Marathe", "author_url": "", "post_date": "2022-08-24T09:15:17.890000", "content": "Hi, I am now able to download the data but again there is an issue.. as the dataset is 350GB ..Colab is throwing an error saying the space is full..what to do?
", "votes": 0, "replies": [] } ] }, { "id": 1912308, "author_name": "zhehao liang", "author_url": "", "post_date": "2022-08-24T16:32:10.763000", "content": "I bought a 1000 GB for colab(Google drive) for this competition. Try to mount google drive first. Then download it and save in google drive.
", "votes": 0, "replies": [ { "id": 1927955, "author_name": "Daniel Macaulay", "author_url": "", "post_date": "2022-09-06T05:49:17.197000", "content": "I'll restate this so I am sure I understand:
\nIs this correct?
", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "1913698": "Would my Discussion be helpful?\n\nhttps://www.kaggle.com/competitions/mayo-clinic-strip-ai/discussion/343470", "1910554": "I presume the below links will help you solve the problem-\n1. https://www.geeksforgeeks.org/how-to-import-kaggle-datasets-directly-into-google-colab/#:~:text=Method%202%3A%20By%20easily%20downloading,folder%20to%20Google%20Colab%20Notebook.\n2. https://www.analyticsvidhya.com/blog/2021/06/how-to-load-kaggle-datasets-directly-into-google-colab/\n3. https://www.kaggle.com/general/74235\n\nYou need to create an API token in your Kaggle profile and use it as a bridge between colab and Kaggle. ", "1910083": "I am very new to Kaggle and overall Deep learning. Can someone help with importing kaggle datasets onto Colab without downloading it in local system? Is it even possible? e.g. I want to train my network of STRIP-AI on Colab but the dataset is around 350GB.. so what to do?", "1912308": "I bought a 1000 GB for colab(Google drive) for this competition. Try to mount google drive first. Then download it and save in google drive. " } }