{ "id": 371288, "title": "LB Score = 0.00", "url": "/competitions/rsna-breast-cancer-detection/discussion/371288", "author_name": "happymentee", "post_date": "2022-12-09T05:09:00.255000", "votes": 0, "comment_count": 9, "views": 0, "content": "

My submission has LB score equal to 0. Why did this happen? Which approach should I consider dealing with?

", "messages": [ { "id": 2061622, "postDate": "2022-12-11T10:34:10.193Z", "content": "

This is a guess, but I suspect that you are submitting predictions of all zeros.
\nI expect that all predicted values are fixed at 0, probably because the threshold is set high.

", "rawMarkdown": "This is a guess, but I suspect that you are submitting predictions of all zeros.\nI expect that all predicted values are fixed at 0, probably because the threshold is set high.", "votes": 1 }, { "id": 2060284, "postDate": "2022-12-09T17:21:51.720Z", "content": "

Hard to say without looking at your notebook. Could be a bug in your code, could be just because you're not identifying any true positives or if you are, not enough to get your score over .00444

\n

If you just submit all 1s, for example, you should get at least .04 score.

", "rawMarkdown": "Hard to say without looking at your notebook. Could be a bug in your code, could be just because you're not identifying any true positives or if you are, not enough to get your score over .00444\n\nIf you just submit all 1s, for example, you should get at least .04 score.", "votes": 1, "replies": [ { "id": 2060332, "postDate": "2022-12-09T18:42:02.780Z", "content": "

Thank you, that helps

", "rawMarkdown": "Thank you, that helps " } ] }, { "id": 2127629, "postDate": "2023-02-03T02:16:48.890Z", "content": "

Hi, recently I encountered the same problem. Did u finally solve this problem? If u did, please tell me your solution! thx!🙏

", "rawMarkdown": "Hi, recently I encountered the same problem. Did u finally solve this problem? If u did, please tell me your solution! thx!🙏", "replies": [ { "id": 2127645, "postDate": "2023-02-03T03:07:52.647Z", "content": "

I think it because my model doesn't identifying any true positives, or score less than 0.00444

", "rawMarkdown": "I think it because my model doesn't identifying any true positives, or score less than 0.00444", "replies": [ { "id": 2127649, "postDate": "2023-02-03T03:14:52.753Z", "content": "

Oh I see… So can you tell me how your model performs on validation dataset? Is the pf1 score in your validation dataset also around 0.004?

", "rawMarkdown": "Oh I see... So can you tell me how your model performs on validation dataset? Is the pf1 score in your validation dataset also around 0.004?" }, { "id": 2127679, "postDate": "2023-02-03T03:39:54.087Z", "content": "

at that time, my F1Loss stuck at 0.008 just after batch, my F1Score at this time is 0.04

", "rawMarkdown": "at that time, my F1Loss stuck at 0.008 just after batch, my F1Score at this time is 0.04 " }, { "id": 2127684, "postDate": "2023-02-03T04:03:50.320Z", "content": "

Well that's quite different from my situation… I got a pf1 score of 0.22 on my validation dataset. Anyway thanks for answering me!

", "rawMarkdown": "Well that's quite different from my situation... I got a pf1 score of 0.22 on my validation dataset. Anyway thanks for answering me! " } ] } ] }, { "id": 2059646, "postDate": "2022-12-09T05:09:00.257Z", "content": "

My submission has LB score equal to 0. Why did this happen? Which approach should I consider dealing with?

", "rawMarkdown": "My submission has LB score equal to 0. Why did this happen? Which approach should I consider dealing with?" }, { "id": 2060277, "postDate": "2022-12-09T17:19:54.460Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 2061622, "author_name": "YYama", "author_url": "", "post_date": "2022-12-11T10:34:10.193000", "content": "

This is a guess, but I suspect that you are submitting predictions of all zeros.
\nI expect that all predicted values are fixed at 0, probably because the threshold is set high.

", "votes": 1, "replies": [] }, { "id": 2060284, "author_name": "@kaggleqrdl", "author_url": "", "post_date": "2022-12-09T17:21:51.720000", "content": "

Hard to say without looking at your notebook. Could be a bug in your code, could be just because you're not identifying any true positives or if you are, not enough to get your score over .00444

\n

If you just submit all 1s, for example, you should get at least .04 score.

", "votes": 1, "replies": [ { "id": 2060332, "author_name": "happymentee", "author_url": "", "post_date": "2022-12-09T18:42:02.780000", "content": "

Thank you, that helps

", "votes": 0, "replies": [] } ] }, { "id": 2127629, "author_name": "Lau2664", "author_url": "", "post_date": "2023-02-03T02:16:48.890000", "content": "

Hi, recently I encountered the same problem. Did u finally solve this problem? If u did, please tell me your solution! thx!🙏

", "votes": 0, "replies": [ { "id": 2127645, "author_name": "happymentee", "author_url": "", "post_date": "2023-02-03T03:07:52.647000", "content": "

I think it because my model doesn't identifying any true positives, or score less than 0.00444

", "votes": 0, "replies": [ { "id": 2127649, "author_name": "Lau2664", "author_url": "", "post_date": "2023-02-03T03:14:52.753000", "content": "

Oh I see… So can you tell me how your model performs on validation dataset? Is the pf1 score in your validation dataset also around 0.004?

", "votes": 0, "replies": [] }, { "id": 2127679, "author_name": "happymentee", "author_url": "", "post_date": "2023-02-03T03:39:54.087000", "content": "

at that time, my F1Loss stuck at 0.008 just after batch, my F1Score at this time is 0.04

", "votes": 0, "replies": [] }, { "id": 2127684, "author_name": "Lau2664", "author_url": "", "post_date": "2023-02-03T04:03:50.320000", "content": "

Well that's quite different from my situation… I got a pf1 score of 0.22 on my validation dataset. Anyway thanks for answering me!

", "votes": 0, "replies": [] } ] } ] }, { "id": 2060277, "author_name": "", "author_url": "", "post_date": "2022-12-09T17:19:54.460000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "2061622": "This is a guess, but I suspect that you are submitting predictions of all zeros.\nI expect that all predicted values are fixed at 0, probably because the threshold is set high.", "2060284": "Hard to say without looking at your notebook. Could be a bug in your code, could be just because you're not identifying any true positives or if you are, not enough to get your score over .00444\n\nIf you just submit all 1s, for example, you should get at least .04 score.", "2127629": "Hi, recently I encountered the same problem. Did u finally solve this problem? If u did, please tell me your solution! thx!🙏", "2059646": "My submission has LB score equal to 0. Why did this happen? Which approach should I consider dealing with?", "2060277": "" } }