{
  "id": 165524,
  "title": "[Beginner Q] Test Images Directory Not Found",
  "url": "/competitions/prostate-cancer-grade-assessment/discussion/165524",
  "author_name": "TimsTheBomb",
  "post_date": "2020-07-10T04:14:38.044000",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi All,</p>\n\n<p>I'm new so please go easy on me! I promise I've read a few similar questions and am still baffled, but if there is a clear description elsewhere please let me know.</p>\n\n<p>I am having trouble figuring out exactly when test images are available to generate competition predictions against. Currently, the process of generating a notebook appears to be as such:</p>\n\n<p>| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | False |</p>\n\n<p>So how exactly do I predict against test images? I understand when step 1, in interactive mode, test_images should not be present. But when \"commit\"ting the notebook, I run into the following error:</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F4974217%2F893a94a751f5d62cfb43e45ef14569e8%2FScreenshot%20from%202020-07-10%2000-11-30.png?generation=1594354311456499&amp;alt=media\" alt=\"\"></p>\n\n<p>(Notebook is <a href=\"https://www.kaggle.com/timsthebomb/fastaiv2-resnet34-dynamic-unet/output\">here</a> for reference)</p>\n\n<p>I'd like to get a first pass, end-to-end process going and it seems that I'm stuck on the second to last step- finding the files to predict. It's very frustrating, I'm not even a data scientist yet and I am already running into data pipeline issues!</p>\n\n<p>Any help or advice would be appreciated.</p>",
  "messages": [
    {
      "id": 922378,
      "postDate": "2020-07-10T04:14:38.043Z",
      "content": "<p>Hi All,</p>\n\n<p>I'm new so please go easy on me! I promise I've read a few similar questions and am still baffled, but if there is a clear description elsewhere please let me know.</p>\n\n<p>I am having trouble figuring out exactly when test images are available to generate competition predictions against. Currently, the process of generating a notebook appears to be as such:</p>\n\n<p>| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | False |</p>\n\n<p>So how exactly do I predict against test images? I understand when step 1, in interactive mode, test_images should not be present. But when \"commit\"ting the notebook, I run into the following error:</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F4974217%2F893a94a751f5d62cfb43e45ef14569e8%2FScreenshot%20from%202020-07-10%2000-11-30.png?generation=1594354311456499&amp;alt=media\" alt=\"\"></p>\n\n<p>(Notebook is <a href=\"https://www.kaggle.com/timsthebomb/fastaiv2-resnet34-dynamic-unet/output\">here</a> for reference)</p>\n\n<p>I'd like to get a first pass, end-to-end process going and it seems that I'm stuck on the second to last step- finding the files to predict. It's very frustrating, I'm not even a data scientist yet and I am already running into data pipeline issues!</p>\n\n<p>Any help or advice would be appreciated.</p>",
      "rawMarkdown": "Hi All,\n\nI'm new so please go easy on me! I promise I've read a few similar questions and am still baffled, but if there is a clear description elsewhere please let me know.\n\nI am having trouble figuring out exactly when test images are available to generate competition predictions against. Currently, the process of generating a notebook appears to be as such:\n\n| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | False |\n\nSo how exactly do I predict against test images? I understand when step 1, in interactive mode, test_images should not be present. But when \"commit\"ting the notebook, I run into the following error:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F4974217%2F893a94a751f5d62cfb43e45ef14569e8%2FScreenshot%20from%202020-07-10%2000-11-30.png?generation=1594354311456499&amp;alt=media)\n\n(Notebook is [here](https://www.kaggle.com/timsthebomb/fastaiv2-resnet34-dynamic-unet/output) for reference)\n\nI'd like to get a first pass, end-to-end process going and it seems that I'm stuck on the second to last step- finding the files to predict. It's very frustrating, I'm not even a data scientist yet and I am already running into data pipeline issues!\n\nAny help or advice would be appreciated.",
      "votes": 1
    },
    {
      "id": 922448,
      "postDate": "2020-07-10T05:35:46.907Z",
      "content": "<p>Formulating the problem seems to have helped me figure it out!</p>\n\n<p>It appears that I was mistaken- the last step, when you submit a notebook to a competition, is when the notebook is run and has access to test data in the test_images folder. The correct matrix looks like this:</p>\n\n<p>| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |</p>",
      "rawMarkdown": "Formulating the problem seems to have helped me figure it out!\n\nIt appears that I was mistaken- the last step, when you submit a notebook to a competition, is when the notebook is run and has access to test data in the test_images folder. The correct matrix looks like this:\n\n| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |"
    },
    {
      "id": 922410,
      "postDate": "2020-07-10T05:05:51.043Z",
      "content": "<p>I may have been mistaken!</p>\n\n<p>It looks like once you commit a notebook, you can submit it via the notebook's page (not the edit page).</p>\n\n<p>When you try to submit it, it's not just reviewing your bogus results, it seems to actually run the notebook to generate a new submission.csv, I imagine with access to the final test files. For instance, my slow, e2e baselines test has been trying to generate a score for over an hour now:</p>\n\n<p>| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |</p>",
      "rawMarkdown": "I may have been mistaken!\n\nIt looks like once you commit a notebook, you can submit it via the notebook's page (not the edit page).\n\nWhen you try to submit it, it's not just reviewing your bogus results, it seems to actually run the notebook to generate a new submission.csv, I imagine with access to the final test files. For instance, my slow, e2e baselines test has been trying to generate a score for over an hour now:\n\n\n| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |\n\n"
    }
  ],
  "comments": [
    {
      "id": 922448,
      "author_name": "TimsTheBomb",
      "author_url": "",
      "post_date": "2020-07-10T05:35:46.907000",
      "content": "<p>Formulating the problem seems to have helped me figure it out!</p>\n\n<p>It appears that I was mistaken- the last step, when you submit a notebook to a competition, is when the notebook is run and has access to test data in the test_images folder. The correct matrix looks like this:</p>\n\n<p>| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 922410,
      "author_name": "TimsTheBomb",
      "author_url": "",
      "post_date": "2020-07-10T05:05:51.043000",
      "content": "<p>I may have been mistaken!</p>\n\n<p>It looks like once you commit a notebook, you can submit it via the notebook's page (not the edit page).</p>\n\n<p>When you try to submit it, it's not just reviewing your bogus results, it seems to actually run the notebook to generate a new submission.csv, I imagine with access to the final test files. For instance, my slow, e2e baselines test has been trying to generate a score for over an hour now:</p>\n\n<p>| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "922378": "Hi All,\n\nI'm new so please go easy on me! I promise I've read a few similar questions and am still baffled, but if there is a clear description elsewhere please let me know.\n\nI am having trouble figuring out exactly when test images are available to generate competition predictions against. Currently, the process of generating a notebook appears to be as such:\n\n| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | False |\n\nSo how exactly do I predict against test images? I understand when step 1, in interactive mode, test_images should not be present. But when \"commit\"ting the notebook, I run into the following error:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F4974217%2F893a94a751f5d62cfb43e45ef14569e8%2FScreenshot%20from%202020-07-10%2000-11-30.png?generation=1594354311456499&amp;alt=media)\n\n(Notebook is [here](https://www.kaggle.com/timsthebomb/fastaiv2-resnet34-dynamic-unet/output) for reference)\n\nI'd like to get a first pass, end-to-end process going and it seems that I'm stuck on the second to last step- finding the files to predict. It's very frustrating, I'm not even a data scientist yet and I am already running into data pipeline issues!\n\nAny help or advice would be appreciated.",
    "922448": "Formulating the problem seems to have helped me figure it out!\n\nIt appears that I was mistaken- the last step, when you submit a notebook to a competition, is when the notebook is run and has access to test data in the test_images folder. The correct matrix looks like this:\n\n| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |",
    "922410": "I may have been mistaken!\n\nIt looks like once you commit a notebook, you can submit it via the notebook's page (not the edit page).\n\nWhen you try to submit it, it's not just reviewing your bogus results, it seems to actually run the notebook to generate a new submission.csv, I imagine with access to the final test files. For instance, my slow, e2e baselines test has been trying to generate a score for over an hour now:\n\n\n| Step | Description | test_images directory present |\n| --- | --- |\n| 1 | Notebook Interactive Mode | False |\n| 2 | Save and Run All (Commit) Option Inside Notebook | False |\n| 3 | Notebook page - Submit Output | True |\n\n"
  }
}