{
  "id": 344384,
  "title": "Notebook Threw Exception, Now What?",
  "url": "/competitions/mayo-clinic-strip-ai/discussion/344384",
  "author_name": "Dino Wun",
  "post_date": "2022-08-15T03:25:26.902000",
  "votes": 4,
  "comment_count": 3,
  "views": 0,
  "content": "<p>When I work on my ensembler model that ensembled three models: DenseNet, EfficientNet, and Vision Transformer, I submit three separate submission files and ensemble them together with this code:</p>\n<pre><code>import os\nimport gc\nimport cv2\nimport copy\nimport time\nimport random\nimport string\nimport joblib\nimport tifffile\nimport numpy as np \nimport pandas as pd \nimport torch\nimport torchvision\nfrom torch import nn\nimport seaborn as sns\nfrom torchvision import models\nimport matplotlib.pyplot as plt\nfrom torch.utils.data import Dataset, DataLoader\nfrom sklearn.model_selection import train_test_split, StratifiedKFold, GroupKFold, KFold\nfrom tqdm.notebook import tqdm\nfrom torch.optim import lr_scheduler\nimport torch.optim as optim\nimport torch.nn as nn\nimport torch.nn.functional as F\nimport torchvision.transforms as transforms\nimport warnings\nwarnings.filterwarnings(\"ignore\")\n</code></pre>\n<pre><code>submission_vit = pd.read_csv(\"../input/vit-inference-in-clots-infer/submission_vit.csv\")\nsubmission_efficientnet = pd.read_csv(\"../input/efficientnet-inference-in-clots-infer/submission_efficientnet.csv\")\nsubmission_densenet = pd.read_csv(\"../input/dino-s-densenet-inference-in-clots-infer/submission_densenet.csv\")\nsub_df = pd.read_csv('../input/mayo-clinic-strip-ai/sample_submission.csv')\n\nsub_df['CE'] = (submission_efficientnet['CE'].values + submission_vit['CE'].values + submission_densenet['CE'].values) / 3.0\nsub_df['LAA'] = (submission_efficientnet['LAA'].values + submission_vit['LAA'].values + submission_densenet['LAA'].values) / 3.0\n\nsub_df.to_csv('submission.csv', index = False)\nsub_df.head()\n</code></pre>\n<p>After I submit this, I got an error after submitting this file because my notebook threw an exception. So, what caused this \"Notebook Threw Exception\" error on my model ensembler notebook? </p>",
  "messages": [
    {
      "id": 1899051,
      "postDate": "2022-08-15T03:25:26.903Z",
      "content": "<p>When I work on my ensembler model that ensembled three models: DenseNet, EfficientNet, and Vision Transformer, I submit three separate submission files and ensemble them together with this code:</p>\n<pre><code>import os\nimport gc\nimport cv2\nimport copy\nimport time\nimport random\nimport string\nimport joblib\nimport tifffile\nimport numpy as np \nimport pandas as pd \nimport torch\nimport torchvision\nfrom torch import nn\nimport seaborn as sns\nfrom torchvision import models\nimport matplotlib.pyplot as plt\nfrom torch.utils.data import Dataset, DataLoader\nfrom sklearn.model_selection import train_test_split, StratifiedKFold, GroupKFold, KFold\nfrom tqdm.notebook import tqdm\nfrom torch.optim import lr_scheduler\nimport torch.optim as optim\nimport torch.nn as nn\nimport torch.nn.functional as F\nimport torchvision.transforms as transforms\nimport warnings\nwarnings.filterwarnings(\"ignore\")\n</code></pre>\n<pre><code>submission_vit = pd.read_csv(\"../input/vit-inference-in-clots-infer/submission_vit.csv\")\nsubmission_efficientnet = pd.read_csv(\"../input/efficientnet-inference-in-clots-infer/submission_efficientnet.csv\")\nsubmission_densenet = pd.read_csv(\"../input/dino-s-densenet-inference-in-clots-infer/submission_densenet.csv\")\nsub_df = pd.read_csv('../input/mayo-clinic-strip-ai/sample_submission.csv')\n\nsub_df['CE'] = (submission_efficientnet['CE'].values + submission_vit['CE'].values + submission_densenet['CE'].values) / 3.0\nsub_df['LAA'] = (submission_efficientnet['LAA'].values + submission_vit['LAA'].values + submission_densenet['LAA'].values) / 3.0\n\nsub_df.to_csv('submission.csv', index = False)\nsub_df.head()\n</code></pre>\n<p>After I submit this, I got an error after submitting this file because my notebook threw an exception. So, what caused this \"Notebook Threw Exception\" error on my model ensembler notebook? </p>",
      "rawMarkdown": "When I work on my ensembler model that ensembled three models: DenseNet, EfficientNet, and Vision Transformer, I submit three separate submission files and ensemble them together with this code:\n```\nimport os\nimport gc\nimport cv2\nimport copy\nimport time\nimport random\nimport string\nimport joblib\nimport tifffile\nimport numpy as np \nimport pandas as pd \nimport torch\nimport torchvision\nfrom torch import nn\nimport seaborn as sns\nfrom torchvision import models\nimport matplotlib.pyplot as plt\nfrom torch.utils.data import Dataset, DataLoader\nfrom sklearn.model_selection import train_test_split, StratifiedKFold, GroupKFold, KFold\nfrom tqdm.notebook import tqdm\nfrom torch.optim import lr_scheduler\nimport torch.optim as optim\nimport torch.nn as nn\nimport torch.nn.functional as F\nimport torchvision.transforms as transforms\nimport warnings\nwarnings.filterwarnings(\"ignore\")\n```\n```\nsubmission_vit = pd.read_csv(\"../input/vit-inference-in-clots-infer/submission_vit.csv\")\nsubmission_efficientnet = pd.read_csv(\"../input/efficientnet-inference-in-clots-infer/submission_efficientnet.csv\")\nsubmission_densenet = pd.read_csv(\"../input/dino-s-densenet-inference-in-clots-infer/submission_densenet.csv\")\nsub_df = pd.read_csv('../input/mayo-clinic-strip-ai/sample_submission.csv')\n\nsub_df['CE'] = (submission_efficientnet['CE'].values + submission_vit['CE'].values + submission_densenet['CE'].values) / 3.0\nsub_df['LAA'] = (submission_efficientnet['LAA'].values + submission_vit['LAA'].values + submission_densenet['LAA'].values) / 3.0\n\nsub_df.to_csv('submission.csv', index = False)\nsub_df.head()\n```\n\nAfter I submit this, I got an error after submitting this file because my notebook threw an exception. So, what caused this \"Notebook Threw Exception\" error on my model ensembler notebook? ",
      "votes": 4
    },
    {
      "id": 1900983,
      "postDate": "2022-08-16T11:52:55.743Z",
      "content": "<p>I was struggling with simillar issues until I just wrapped it all with try-except-pass since I just couldn't find where the error came from..</p>\n<p>The Devastator.</p>",
      "rawMarkdown": "I was struggling with simillar issues until I just wrapped it all with try-except-pass since I just couldn't find where the error came from..\n\nThe Devastator.\n",
      "votes": 1
    },
    {
      "id": 1900756,
      "postDate": "2022-08-16T08:25:58.723Z",
      "content": "<p>Do you have a more detailed error message you could share? This would help debug your issue.</p>",
      "rawMarkdown": "Do you have a more detailed error message you could share? This would help debug your issue."
    },
    {
      "id": 1901568,
      "postDate": "2022-08-16T18:47:48.500Z",
      "content": "<p>Im not sure because most parts of your code are omitted someway, but did you check values in your sub_df are per patient_id, not per image_id? </p>",
      "rawMarkdown": "Im not sure because most parts of your code are omitted someway, but did you check values in your sub_df are per patient_id, not per image_id? ",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1900983,
      "author_name": "The Devastator",
      "author_url": "",
      "post_date": "2022-08-16T11:52:55.743000",
      "content": "<p>I was struggling with simillar issues until I just wrapped it all with try-except-pass since I just couldn't find where the error came from..</p>\n<p>The Devastator.</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1900756,
      "author_name": "Thomas Rialan",
      "author_url": "",
      "post_date": "2022-08-16T08:25:58.723000",
      "content": "<p>Do you have a more detailed error message you could share? This would help debug your issue.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1901568,
      "author_name": "",
      "author_url": "",
      "post_date": "2022-08-16T18:47:48.500000",
      "content": "<p>Im not sure because most parts of your code are omitted someway, but did you check values in your sub_df are per patient_id, not per image_id? </p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1899051": "When I work on my ensembler model that ensembled three models: DenseNet, EfficientNet, and Vision Transformer, I submit three separate submission files and ensemble them together with this code:\n```\nimport os\nimport gc\nimport cv2\nimport copy\nimport time\nimport random\nimport string\nimport joblib\nimport tifffile\nimport numpy as np \nimport pandas as pd \nimport torch\nimport torchvision\nfrom torch import nn\nimport seaborn as sns\nfrom torchvision import models\nimport matplotlib.pyplot as plt\nfrom torch.utils.data import Dataset, DataLoader\nfrom sklearn.model_selection import train_test_split, StratifiedKFold, GroupKFold, KFold\nfrom tqdm.notebook import tqdm\nfrom torch.optim import lr_scheduler\nimport torch.optim as optim\nimport torch.nn as nn\nimport torch.nn.functional as F\nimport torchvision.transforms as transforms\nimport warnings\nwarnings.filterwarnings(\"ignore\")\n```\n```\nsubmission_vit = pd.read_csv(\"../input/vit-inference-in-clots-infer/submission_vit.csv\")\nsubmission_efficientnet = pd.read_csv(\"../input/efficientnet-inference-in-clots-infer/submission_efficientnet.csv\")\nsubmission_densenet = pd.read_csv(\"../input/dino-s-densenet-inference-in-clots-infer/submission_densenet.csv\")\nsub_df = pd.read_csv('../input/mayo-clinic-strip-ai/sample_submission.csv')\n\nsub_df['CE'] = (submission_efficientnet['CE'].values + submission_vit['CE'].values + submission_densenet['CE'].values) / 3.0\nsub_df['LAA'] = (submission_efficientnet['LAA'].values + submission_vit['LAA'].values + submission_densenet['LAA'].values) / 3.0\n\nsub_df.to_csv('submission.csv', index = False)\nsub_df.head()\n```\n\nAfter I submit this, I got an error after submitting this file because my notebook threw an exception. So, what caused this \"Notebook Threw Exception\" error on my model ensembler notebook? ",
    "1900983": "I was struggling with simillar issues until I just wrapped it all with try-except-pass since I just couldn't find where the error came from..\n\nThe Devastator.\n",
    "1900756": "Do you have a more detailed error message you could share? This would help debug your issue.",
    "1901568": "Im not sure because most parts of your code are omitted someway, but did you check values in your sub_df are per patient_id, not per image_id? "
  }
}