{
  "id": 390534,
  "title": "[Solved] Multi-view model outputs nan's",
  "url": "/competitions/rsna-breast-cancer-detection/discussion/390534",
  "author_name": "Antti Isosalo",
  "post_date": "2023-02-26T03:17:15.551000",
  "votes": 0,
  "comment_count": 0,
  "views": 0,
  "content": "<p>👋 Greetings,</p>\n<p>I've been attempting to make and train a multi-view model to directly predict labels for L and R from 16-bit mammograms.</p>\n<p>The model often (at least in 20% of the cases) outputs nan's as predictions for both or one of the lateralities. (I've concatenated the output from the two branches and the positive predictions are at places 0 and 2.)</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F13477216%2F6955423c6ddae6e37d75a22e8dd236f1%2F7002.png?generation=1677379377311828&amp;alt=media\" alt=\"\"></p>\n<p>In this particular case the default windowing / VOI LUT does not provide the best outcome.</p>\n<p>Another thing might be that I have standardized each image individually to have zero mean and unit standard deviation. This has been the safest way with mammograms in my earlier studies. Perhaps I should reconsider?</p>\n<p>What I could have also done would have been to train separate models for the two TransferSyntaxUID's, but it might be too late for that.</p>\n<p>It seems that multi-view models in general are challenging to train even though here when I flip the right hand side images to face right and use flip augmentation it is rather multi-projection model, where the differences between MLO and CC might do some harm for the training.</p>\n<p>EDIT: nan's were due to improper use of <code>amp</code>. 😅 Let's see if I can get a better Late Submission score.</p>\n<p>Best,</p>\n<p>Antti </p>",
  "messages": [
    {
      "id": 2159766,
      "postDate": "2023-02-26T03:17:15.550Z",
      "content": "<p>👋 Greetings,</p>\n<p>I've been attempting to make and train a multi-view model to directly predict labels for L and R from 16-bit mammograms.</p>\n<p>The model often (at least in 20% of the cases) outputs nan's as predictions for both or one of the lateralities. (I've concatenated the output from the two branches and the positive predictions are at places 0 and 2.)</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F13477216%2F6955423c6ddae6e37d75a22e8dd236f1%2F7002.png?generation=1677379377311828&amp;alt=media\" alt=\"\"></p>\n<p>In this particular case the default windowing / VOI LUT does not provide the best outcome.</p>\n<p>Another thing might be that I have standardized each image individually to have zero mean and unit standard deviation. This has been the safest way with mammograms in my earlier studies. Perhaps I should reconsider?</p>\n<p>What I could have also done would have been to train separate models for the two TransferSyntaxUID's, but it might be too late for that.</p>\n<p>It seems that multi-view models in general are challenging to train even though here when I flip the right hand side images to face right and use flip augmentation it is rather multi-projection model, where the differences between MLO and CC might do some harm for the training.</p>\n<p>EDIT: nan's were due to improper use of <code>amp</code>. 😅 Let's see if I can get a better Late Submission score.</p>\n<p>Best,</p>\n<p>Antti </p>",
      "rawMarkdown": "👋 Greetings,\n\nI've been attempting to make and train a multi-view model to directly predict labels for L and R from 16-bit mammograms.\n\nThe model often (at least in 20% of the cases) outputs nan's as predictions for both or one of the lateralities. (I've concatenated the output from the two branches and the positive predictions are at places 0 and 2.)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F13477216%2F6955423c6ddae6e37d75a22e8dd236f1%2F7002.png?generation=1677379377311828&alt=media)\n\nIn this particular case the default windowing / VOI LUT does not provide the best outcome.\n\nAnother thing might be that I have standardized each image individually to have zero mean and unit standard deviation. This has been the safest way with mammograms in my earlier studies. Perhaps I should reconsider?\n\nWhat I could have also done would have been to train separate models for the two TransferSyntaxUID's, but it might be too late for that.\n\nIt seems that multi-view models in general are challenging to train even though here when I flip the right hand side images to face right and use flip augmentation it is rather multi-projection model, where the differences between MLO and CC might do some harm for the training.\n\nEDIT: nan's were due to improper use of `amp`. 😅 Let's see if I can get a better Late Submission score.\n\nBest,\n\nAntti "
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2159766": "👋 Greetings,\n\nI've been attempting to make and train a multi-view model to directly predict labels for L and R from 16-bit mammograms.\n\nThe model often (at least in 20% of the cases) outputs nan's as predictions for both or one of the lateralities. (I've concatenated the output from the two branches and the positive predictions are at places 0 and 2.)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F13477216%2F6955423c6ddae6e37d75a22e8dd236f1%2F7002.png?generation=1677379377311828&alt=media)\n\nIn this particular case the default windowing / VOI LUT does not provide the best outcome.\n\nAnother thing might be that I have standardized each image individually to have zero mean and unit standard deviation. This has been the safest way with mammograms in my earlier studies. Perhaps I should reconsider?\n\nWhat I could have also done would have been to train separate models for the two TransferSyntaxUID's, but it might be too late for that.\n\nIt seems that multi-view models in general are challenging to train even though here when I flip the right hand side images to face right and use flip augmentation it is rather multi-projection model, where the differences between MLO and CC might do some harm for the training.\n\nEDIT: nan's were due to improper use of `amp`. 😅 Let's see if I can get a better Late Submission score.\n\nBest,\n\nAntti "
  }
}