{
  "id": 587936,
  "title": "ExoSim2: We know how to generate data!",
  "url": "/competitions/ariel-data-challenge-2025/discussion/587936",
  "author_name": "greySnow",
  "post_date": "2025-07-03T13:45:40.137000",
  "votes": 36,
  "comment_count": 31,
  "views": 0,
  "content": "<p>You might think it's Ariel2024, only a little bit harder. This is not the case.<br>\nIt'll probably be Ariel2024+Yale/UNC-CH on steroids.  <br>\nSomething very important is common to Ariel2025 and Yale/UNC-CH: we have access to the code to generate data. It means all the tricks we have seen in Yale are in the game here. Although doing things with the test set (e.g., overfitting each sample or predict-simulate-train loop) will be harder since we can only do them during the prediction, as this is a code competition. But at the very least, we can generate more data and train on it- it was enough to get 3rd and 4th place in Yale.  <br>\nI'm not sure it's <strong>smart</strong> for me to write this secret, but I'm sure that top competitors here are already aware of this fact, since they participated, like me, both in Ariel2024 and Yale, and they are too smart to miss something so obvious. So, competing for the price range will probably remain the same difficulty. So I'm like, you know, I'm just feeling like letting chaos rain a little bit in this competition, and let's see what will happen :) Since now I have made sure that everyone is aware of this fact, I hope to see interesting data generation and clever tricks notebooks. It's a great opportunity to earn some notebooks and datasets gold medals, go go go :)</p>\n<p><a href=\"https://github.com/arielmission-space/ExoSim2-public/blob/main/examples/example_pipeline.ipynb\" target=\"_blank\">Here is a link to an example from the data generation repo</a></p>",
  "messages": [
    {
      "id": 3240134,
      "postDate": "2025-07-03T13:45:40.137Z",
      "content": "<p>You might think it's Ariel2024, only a little bit harder. This is not the case.<br>\nIt'll probably be Ariel2024+Yale/UNC-CH on steroids.  <br>\nSomething very important is common to Ariel2025 and Yale/UNC-CH: we have access to the code to generate data. It means all the tricks we have seen in Yale are in the game here. Although doing things with the test set (e.g., overfitting each sample or predict-simulate-train loop) will be harder since we can only do them during the prediction, as this is a code competition. But at the very least, we can generate more data and train on it- it was enough to get 3rd and 4th place in Yale.  <br>\nI'm not sure it's <strong>smart</strong> for me to write this secret, but I'm sure that top competitors here are already aware of this fact, since they participated, like me, both in Ariel2024 and Yale, and they are too smart to miss something so obvious. So, competing for the price range will probably remain the same difficulty. So I'm like, you know, I'm just feeling like letting chaos rain a little bit in this competition, and let's see what will happen :) Since now I have made sure that everyone is aware of this fact, I hope to see interesting data generation and clever tricks notebooks. It's a great opportunity to earn some notebooks and datasets gold medals, go go go :)</p>\n<p><a href=\"https://github.com/arielmission-space/ExoSim2-public/blob/main/examples/example_pipeline.ipynb\" target=\"_blank\">Here is a link to an example from the data generation repo</a></p>",
      "rawMarkdown": "You might think it's Ariel2024, only a little bit harder. This is not the case.\nIt'll probably be Ariel2024+Yale/UNC-CH on steroids.  \nSomething very important is common to Ariel2025 and Yale/UNC-CH: we have access to the code to generate data. It means all the tricks we have seen in Yale are in the game here. Although doing things with the test set (e.g., overfitting each sample or predict-simulate-train loop) will be harder since we can only do them during the prediction, as this is a code competition. But at the very least, we can generate more data and train on it- it was enough to get 3rd and 4th place in Yale.  \nI'm not sure it's **smart** for me to write this secret, but I'm sure that top competitors here are already aware of this fact, since they participated, like me, both in Ariel2024 and Yale, and they are too smart to miss something so obvious. So, competing for the price range will probably remain the same difficulty. So I'm like, you know, I'm just feeling like letting chaos rain a little bit in this competition, and let's see what will happen :) Since now I have made sure that everyone is aware of this fact, I hope to see interesting data generation and clever tricks notebooks. It's a great opportunity to earn some notebooks and datasets gold medals, go go go :)\n\n[Here is a link to an example from the data generation repo](https://github.com/arielmission-space/ExoSim2-public/blob/main/examples/example_pipeline.ipynb)",
      "votes": 35
    },
    {
      "id": 3244945,
      "postDate": "2025-07-08T17:42:26.550Z",
      "content": "<p>I must remind everyone of <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a>'s wise words last year, which it seems everyone is going to have to relearn this year.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F14984949%2Fda50e27e9c2aac44f6cba5afd73444e5%2FScreenshot%202025-07-08%20194214.png?generation=1751996542864798&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "I must remind everyone of @shlomoron's wise words last year, which it seems everyone is going to have to relearn this year.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F14984949%2Fda50e27e9c2aac44f6cba5afd73444e5%2FScreenshot%202025-07-08%20194214.png?generation=1751996542864798&alt=media)",
      "votes": 5,
      "replies": [
        {
          "id": 3244997,
          "postDate": "2025-07-08T18:10:53.277Z",
          "content": "<p>Unless it's going to be signal processing again, and I just sent half the community on the wrong track! (Which is the correct answer? I don't know myself yet :) )</p>",
          "rawMarkdown": "Unless it's going to be signal processing again, and I just sent half the community on the wrong track! (Which is the correct answer? I don't know myself yet :) )",
          "votes": 2
        }
      ]
    },
    {
      "id": 3241496,
      "postDate": "2025-07-04T20:40:20.813Z",
      "content": "<p>This topic this discussion I really amazed by this <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a></p>",
      "rawMarkdown": "This topic this discussion I really amazed by this @shlomoron",
      "votes": 3
    },
    {
      "id": 3241494,
      "postDate": "2025-07-04T20:39:01.100Z",
      "content": "<p>Good to know! Time to generate some data then. Game on! thanks for this topic discussion <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a> </p>",
      "rawMarkdown": "Good to know! Time to generate some data then. Game on! thanks for this topic discussion @shlomoron ",
      "votes": 3
    },
    {
      "id": 3240843,
      "postDate": "2025-07-04T09:19:19.470Z",
      "content": "<p>I spent a lot of time on this last year. Still, there are a lot of things unknown when setting up the generation pipeline regarding the sensor setup and parameters. I had a very hard time getting close to the competition data, but indeed may be something for this year to try.<br>\nThank you for bringing it up here again.</p>",
      "rawMarkdown": "I spent a lot of time on this last year. Still, there are a lot of things unknown when setting up the generation pipeline regarding the sensor setup and parameters. I had a very hard time getting close to the competition data, but indeed may be something for this year to try.\nThank you for bringing it up here again.",
      "votes": 4
    },
    {
      "id": 3240644,
      "postDate": "2025-07-04T04:52:52.727Z",
      "content": "<p>This was actually also known last year - it's just that only one team actually realized it…</p>",
      "rawMarkdown": "This was actually also known last year - it's just that only one team actually realized it...",
      "votes": 4,
      "replies": [
        {
          "id": 3240728,
          "postDate": "2025-07-04T07:11:54.660Z",
          "content": "<p>And they only used it for understanding how to eliminate some noise, yeah.<br>\nBut now we have the experience of Yale- we are not so naive anymore! This would probably no longer be enough to win! 😌</p>",
          "rawMarkdown": "And they only used it for understanding how to eliminate some noise, yeah.\nBut now we have the experience of Yale- we are not so naive anymore! This would probably no longer be enough to win! 😌"
        },
        {
          "id": 3240783,
          "postDate": "2025-07-04T08:21:49.277Z",
          "content": "<p>Looking forward to ML solutions this year!<br>\n(Well you can classify Gaussian Process Regression as ML, but let's forget about that for now)</p>",
          "rawMarkdown": "Looking forward to ML solutions this year!\n(Well you can classify Gaussian Process Regression as ML, but let's forget about that for now)",
          "votes": 1
        }
      ]
    },
    {
      "id": 3241573,
      "postDate": "2025-07-04T22:47:56.810Z",
      "content": "<p>Data crunching competition using many many GPU time again? 😱😱😱</p>",
      "rawMarkdown": "Data crunching competition using many many GPU time again? 😱😱😱",
      "votes": 1
    },
    {
      "id": 3240581,
      "postDate": "2025-07-04T02:37:40.880Z",
      "content": "<p>2024's 5th place used Taurex3, but couldn't get clean matches, it might pay off this year</p>",
      "rawMarkdown": "2024's 5th place used Taurex3, but couldn't get clean matches, it might pay off this year",
      "votes": 1,
      "replies": [
        {
          "id": 3240686,
          "postDate": "2025-07-04T05:47:36.740Z",
          "content": "<p>We also tried taurex3 last year, but didn't work.</p>",
          "rawMarkdown": "We also tried taurex3 last year, but didn't work."
        },
        {
          "id": 3240737,
          "postDate": "2025-07-04T07:21:31.677Z",
          "content": "<p>Thats right, simulation for this competition was made afaik in ExoSim2 and not Taurex3, ao it makes sense you will have hard time get good data with Taurex3. But if someone manage to find good hyperparameters it'll be huge!<br>\n(but probably easier to just follow ExoSim2)</p>",
          "rawMarkdown": "Thats right, simulation for this competition was made afaik in ExoSim2 and not Taurex3, ao it makes sense you will have hard time get good data with Taurex3. But if someone manage to find good hyperparameters it'll be huge!\n(but probably easier to just follow ExoSim2)"
        },
        {
          "id": 3240780,
          "postDate": "2025-07-04T08:19:18.883Z",
          "content": "<p>Last year, our team focused hard on Trauex3 and was able to boost cv, but it didn't work on LB because different types of molecules were used for LB.<br>\nI'm assuming it's the same for this year, and that using the spetrcum of each molecule won't help.</p>",
          "rawMarkdown": "Last year, our team focused hard on Trauex3 and was able to boost cv, but it didn't work on LB because different types of molecules were used for LB.\nI'm assuming it's the same for this year, and that using the spetrcum of each molecule won't help.",
          "votes": 1,
          "replies": [
            {
              "id": 3240792,
              "postDate": "2025-07-04T08:27:04.737Z",
              "content": "<p>Unless you manage to probe LB for the new molecules…</p>",
              "rawMarkdown": "Unless you manage to probe LB for the new molecules..."
            },
            {
              "id": 3241094,
              "postDate": "2025-07-04T14:33:51.373Z",
              "content": "<p>ExoSim2 (if done right) can act as a bridge between Trauex3 and Ariel's deliberately unrealistic reality</p>",
              "rawMarkdown": "ExoSim2 (if done right) can act as a bridge between Trauex3 and Ariel's deliberately unrealistic reality"
            }
          ]
        },
        {
          "id": 3240842,
          "postDate": "2025-07-04T09:17:09.633Z",
          "content": "<p>yes, unknown molecules was the tricky part, though, as there are many degrees of freedom.</p>",
          "rawMarkdown": "yes, unknown molecules was the tricky part, though, as there are many degrees of freedom.",
          "votes": 1,
          "replies": [
            {
              "id": 3241036,
              "postDate": "2025-07-04T13:07:40.980Z",
              "content": "<p>Nice to see you joining this year too!<br>\nIt's going to be a tougher competition than last year.</p>",
              "rawMarkdown": "Nice to see you joining this year too!\nIt's going to be a tougher competition than last year."
            },
            {
              "id": 3241050,
              "postDate": "2025-07-04T13:18:54.920Z",
              "content": "<p>100%.        </p>",
              "rawMarkdown": "100%.        ",
              "votes": 1
            },
            {
              "id": 3241097,
              "postDate": "2025-07-04T14:37:13.483Z",
              "content": "<p>Newbie too!</p>",
              "rawMarkdown": "Newbie too!"
            }
          ]
        }
      ]
    },
    {
      "id": 3240254,
      "postDate": "2025-07-03T16:16:15.600Z",
      "content": "<p>Thanks for sharing <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a>, more data is the secret of Yale is what i missed in last 3 months. But sharing at initial stage of competition is really helpful.</p>",
      "rawMarkdown": "Thanks for sharing @shlomoron, more data is the secret of Yale is what i missed in last 3 months. But sharing at initial stage of competition is really helpful.",
      "votes": 1
    },
    {
      "id": 3241384,
      "postDate": "2025-07-04T18:46:46.893Z",
      "content": "<p>Hi, I am a beginner at kaggle competitions and I often don't understand notebooks and discussions from kaggle geniuses. Can you tell me How did you and where did you learn all these things. PS. I am a self learner , so a bit of hints and roadmaps are appreciated! TIA</p>",
      "rawMarkdown": "Hi, I am a beginner at kaggle competitions and I often don't understand notebooks and discussions from kaggle geniuses. Can you tell me How did you and where did you learn all these things. PS. I am a self learner , so a bit of hints and roadmaps are appreciated! TIA",
      "replies": [
        {
          "id": 3241401,
          "postDate": "2025-07-04T19:08:43.403Z",
          "content": "<p>I tried to win Kaggle competitions 🤷‍♂️ This is how you learn. There is no shortcut. You just have to seriously aim for the top and be good enough.</p>",
          "rawMarkdown": "I tried to win Kaggle competitions 🤷‍♂️ This is how you learn. There is no shortcut. You just have to seriously aim for the top and be good enough.",
          "votes": 4,
          "replies": [
            {
              "id": 3241426,
              "postDate": "2025-07-04T19:30:01.860Z",
              "content": "<p>Ha ha, I like that energy \"This is how you learn.\", I am simply asking for a  resources that might be help to be start good and keep going. Can you share any sources?</p>",
              "rawMarkdown": "Ha ha, I like that energy \"This is how you learn.\", I am simply asking for a  resources that might be help to be start good and keep going. Can you share any sources?"
            },
            {
              "id": 3241432,
              "postDate": "2025-07-04T19:34:32.210Z",
              "content": "<p>The resources are Kaggle notebooks and past competitions top solutions.</p>",
              "rawMarkdown": "The resources are Kaggle notebooks and past competitions top solutions.",
              "votes": 2
            }
          ]
        }
      ]
    },
    {
      "id": 3243143,
      "postDate": "2025-07-06T19:15:41.913Z",
      "content": "<p>Yeah its great info </p>",
      "rawMarkdown": "Yeah its great info "
    },
    {
      "id": 3240632,
      "postDate": "2025-07-04T04:37:24.273Z",
      "content": "<p>Nice sharing!<br>\nI see someone downvoting, maybe they're not happy with this :)</p>",
      "rawMarkdown": "Nice sharing!\nI see someone downvoting, maybe they're not happy with this :)",
      "replies": [
        {
          "id": 3240730,
          "postDate": "2025-07-04T07:15:37.977Z",
          "content": "<p>I probably just made this competition like two or three times more demanding for anything below price range, so I'm sure some people be angry! 🤣</p>",
          "rawMarkdown": "I probably just made this competition like two or three times more demanding for anything below price range, so I'm sure some people be angry! 🤣"
        }
      ]
    },
    {
      "id": 3240202,
      "postDate": "2025-07-03T15:08:12.957Z",
      "content": "<pre><code>It</code></pre>\n<p>Hard! True, my 90% of the submissions end with 0.0</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F23276411%2Fdc01cade481f30e810458ef1174a8cdd%2FScreenshot%20from%202025-07-03%2020-34-17.png?generation=1751555232465597&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "```python\nIt'll probably be Ariel2024+Yale/UNC-CH on steroids. \n```\nHard! True, my 90% of the submissions end with 0.0\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F23276411%2Fdc01cade481f30e810458ef1174a8cdd%2FScreenshot%20from%202025-07-03%2020-34-17.png?generation=1751555232465597&alt=media)",
      "replies": [
        {
          "id": 3240647,
          "postDate": "2025-07-04T05:01:22.547Z",
          "content": "<p>Last year it took me a month to get a score above 0.000. Note that if your model goes haywire on just a single dataset it can already cause this. Having sanity checks and fallbacks in your code is critical.</p>",
          "rawMarkdown": "Last year it took me a month to get a score above 0.000. Note that if your model goes haywire on just a single dataset it can already cause this. Having sanity checks and fallbacks in your code is critical.",
          "votes": 1
        }
      ]
    },
    {
      "id": 3240179,
      "postDate": "2025-07-03T14:32:07.827Z",
      "content": "<p>I missed Yale competition. May I ask for a link?</p>",
      "rawMarkdown": "I missed Yale competition. May I ask for a link?",
      "replies": [
        {
          "id": 3240183,
          "postDate": "2025-07-03T14:35:37.310Z",
          "content": "<p><a href=\"https://www.kaggle.com/competitions/waveform-inversion\" target=\"_blank\">https://www.kaggle.com/competitions/waveform-inversion</a></p>",
          "rawMarkdown": "https://www.kaggle.com/competitions/waveform-inversion",
          "votes": 1
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 3244945,
      "author_name": "Jeroen Cottaar",
      "author_url": "",
      "post_date": "2025-07-08T17:42:26.550000",
      "content": "<p>I must remind everyone of <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a>'s wise words last year, which it seems everyone is going to have to relearn this year.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F14984949%2Fda50e27e9c2aac44f6cba5afd73444e5%2FScreenshot%202025-07-08%20194214.png?generation=1751996542864798&amp;alt=media\" alt=\"\"></p>",
      "votes": 5,
      "replies": [
        {
          "id": 3244997,
          "author_name": "greySnow",
          "author_url": "",
          "post_date": "2025-07-08T18:10:53.277000",
          "content": "<p>Unless it's going to be signal processing again, and I just sent half the community on the wrong track! (Which is the correct answer? I don't know myself yet :) )</p>",
          "votes": 2,
          "replies": []
        }
      ]
    },
    {
      "id": 3241496,
      "author_name": "HijabZahra",
      "author_url": "",
      "post_date": "2025-07-04T20:40:20.813000",
      "content": "<p>This topic this discussion I really amazed by this <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a></p>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 3241494,
      "author_name": "Sadia Shahid latif",
      "author_url": "",
      "post_date": "2025-07-04T20:39:01.100000",
      "content": "<p>Good to know! Time to generate some data then. Game on! thanks for this topic discussion <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a> </p>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 3240843,
      "author_name": "Pascal Pfeiffer",
      "author_url": "",
      "post_date": "2025-07-04T09:19:19.470000",
      "content": "<p>I spent a lot of time on this last year. Still, there are a lot of things unknown when setting up the generation pipeline regarding the sensor setup and parameters. I had a very hard time getting close to the competition data, but indeed may be something for this year to try.<br>\nThank you for bringing it up here again.</p>",
      "votes": 4,
      "replies": []
    },
    {
      "id": 3240644,
      "author_name": "Jeroen Cottaar",
      "author_url": "",
      "post_date": "2025-07-04T04:52:52.727000",
      "content": "<p>This was actually also known last year - it's just that only one team actually realized it…</p>",
      "votes": 4,
      "replies": [
        {
          "id": 3240728,
          "author_name": "greySnow",
          "author_url": "",
          "post_date": "2025-07-04T07:11:54.660000",
          "content": "<p>And they only used it for understanding how to eliminate some noise, yeah.<br>\nBut now we have the experience of Yale- we are not so naive anymore! This would probably no longer be enough to win! 😌</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 3240783,
          "author_name": "c-number",
          "author_url": "",
          "post_date": "2025-07-04T08:21:49.277000",
          "content": "<p>Looking forward to ML solutions this year!<br>\n(Well you can classify Gaussian Process Regression as ML, but let's forget about that for now)</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 3241573,
      "author_name": "🐢 Jun Koda",
      "author_url": "",
      "post_date": "2025-07-04T22:47:56.810000",
      "content": "<p>Data crunching competition using many many GPU time again? 😱😱😱</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 3240581,
      "author_name": "g john rao",
      "author_url": "",
      "post_date": "2025-07-04T02:37:40.880000",
      "content": "<p>2024's 5th place used Taurex3, but couldn't get clean matches, it might pay off this year</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3240686,
          "author_name": "c-number",
          "author_url": "",
          "post_date": "2025-07-04T05:47:36.740000",
          "content": "<p>We also tried taurex3 last year, but didn't work.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 3240737,
          "author_name": "greySnow",
          "author_url": "",
          "post_date": "2025-07-04T07:21:31.677000",
          "content": "<p>Thats right, simulation for this competition was made afaik in ExoSim2 and not Taurex3, ao it makes sense you will have hard time get good data with Taurex3. But if someone manage to find good hyperparameters it'll be huge!<br>\n(but probably easier to just follow ExoSim2)</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 3240780,
          "author_name": "c-number",
          "author_url": "",
          "post_date": "2025-07-04T08:19:18.883000",
          "content": "<p>Last year, our team focused hard on Trauex3 and was able to boost cv, but it didn't work on LB because different types of molecules were used for LB.<br>\nI'm assuming it's the same for this year, and that using the spetrcum of each molecule won't help.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3240792,
              "author_name": "greySnow",
              "author_url": "",
              "post_date": "2025-07-04T08:27:04.737000",
              "content": "<p>Unless you manage to probe LB for the new molecules…</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3241094,
              "author_name": "g john rao",
              "author_url": "",
              "post_date": "2025-07-04T14:33:51.373000",
              "content": "<p>ExoSim2 (if done right) can act as a bridge between Trauex3 and Ariel's deliberately unrealistic reality</p>",
              "votes": 0,
              "replies": []
            }
          ]
        },
        {
          "id": 3240842,
          "author_name": "Pascal Pfeiffer",
          "author_url": "",
          "post_date": "2025-07-04T09:17:09.633000",
          "content": "<p>yes, unknown molecules was the tricky part, though, as there are many degrees of freedom.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3241036,
              "author_name": "c-number",
              "author_url": "",
              "post_date": "2025-07-04T13:07:40.980000",
              "content": "<p>Nice to see you joining this year too!<br>\nIt's going to be a tougher competition than last year.</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3241050,
              "author_name": "Dieter",
              "author_url": "",
              "post_date": "2025-07-04T13:18:54.920000",
              "content": "<p>100%.        </p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3241097,
              "author_name": "Sangram Patil",
              "author_url": "",
              "post_date": "2025-07-04T14:37:13.483000",
              "content": "<p>Newbie too!</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3240254,
      "author_name": "SeshuRaju 🧘‍♂️",
      "author_url": "",
      "post_date": "2025-07-03T16:16:15.600000",
      "content": "<p>Thanks for sharing <a href=\"https://www.kaggle.com/shlomoron\" target=\"_blank\">@shlomoron</a>, more data is the secret of Yale is what i missed in last 3 months. But sharing at initial stage of competition is really helpful.</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 3241384,
      "author_name": "Repello mugglentum!",
      "author_url": "",
      "post_date": "2025-07-04T18:46:46.893000",
      "content": "<p>Hi, I am a beginner at kaggle competitions and I often don't understand notebooks and discussions from kaggle geniuses. Can you tell me How did you and where did you learn all these things. PS. I am a self learner , so a bit of hints and roadmaps are appreciated! TIA</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3241401,
          "author_name": "greySnow",
          "author_url": "",
          "post_date": "2025-07-04T19:08:43.403000",
          "content": "<p>I tried to win Kaggle competitions 🤷‍♂️ This is how you learn. There is no shortcut. You just have to seriously aim for the top and be good enough.</p>",
          "votes": 4,
          "replies": [
            {
              "id": 3241426,
              "author_name": "Repello mugglentum!",
              "author_url": "",
              "post_date": "2025-07-04T19:30:01.860000",
              "content": "<p>Ha ha, I like that energy \"This is how you learn.\", I am simply asking for a  resources that might be help to be start good and keep going. Can you share any sources?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3241432,
              "author_name": "greySnow",
              "author_url": "",
              "post_date": "2025-07-04T19:34:32.210000",
              "content": "<p>The resources are Kaggle notebooks and past competitions top solutions.</p>",
              "votes": 2,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3243143,
      "author_name": "Zunairaa Manshad",
      "author_url": "",
      "post_date": "2025-07-06T19:15:41.913000",
      "content": "<p>Yeah its great info </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3240632,
      "author_name": "c-number",
      "author_url": "",
      "post_date": "2025-07-04T04:37:24.273000",
      "content": "<p>Nice sharing!<br>\nI see someone downvoting, maybe they're not happy with this :)</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3240730,
          "author_name": "greySnow",
          "author_url": "",
          "post_date": "2025-07-04T07:15:37.977000",
          "content": "<p>I probably just made this competition like two or three times more demanding for anything below price range, so I'm sure some people be angry! 🤣</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3240202,
      "author_name": "Sangram Patil",
      "author_url": "",
      "post_date": "2025-07-03T15:08:12.957000",
      "content": "<pre><code>It</code></pre>\n<p>Hard! True, my 90% of the submissions end with 0.0</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F23276411%2Fdc01cade481f30e810458ef1174a8cdd%2FScreenshot%20from%202025-07-03%2020-34-17.png?generation=1751555232465597&amp;alt=media\" alt=\"\"></p>",
      "votes": 0,
      "replies": [
        {
          "id": 3240647,
          "author_name": "Jeroen Cottaar",
          "author_url": "",
          "post_date": "2025-07-04T05:01:22.547000",
          "content": "<p>Last year it took me a month to get a score above 0.000. Note that if your model goes haywire on just a single dataset it can already cause this. Having sanity checks and fallbacks in your code is critical.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 3240179,
      "author_name": "DennisSakva",
      "author_url": "",
      "post_date": "2025-07-03T14:32:07.827000",
      "content": "<p>I missed Yale competition. May I ask for a link?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3240183,
          "author_name": "greySnow",
          "author_url": "",
          "post_date": "2025-07-03T14:35:37.310000",
          "content": "<p><a href=\"https://www.kaggle.com/competitions/waveform-inversion\" target=\"_blank\">https://www.kaggle.com/competitions/waveform-inversion</a></p>",
          "votes": 1,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3240134": "You might think it's Ariel2024, only a little bit harder. This is not the case.\nIt'll probably be Ariel2024+Yale/UNC-CH on steroids.  \nSomething very important is common to Ariel2025 and Yale/UNC-CH: we have access to the code to generate data. It means all the tricks we have seen in Yale are in the game here. Although doing things with the test set (e.g., overfitting each sample or predict-simulate-train loop) will be harder since we can only do them during the prediction, as this is a code competition. But at the very least, we can generate more data and train on it- it was enough to get 3rd and 4th place in Yale.  \nI'm not sure it's **smart** for me to write this secret, but I'm sure that top competitors here are already aware of this fact, since they participated, like me, both in Ariel2024 and Yale, and they are too smart to miss something so obvious. So, competing for the price range will probably remain the same difficulty. So I'm like, you know, I'm just feeling like letting chaos rain a little bit in this competition, and let's see what will happen :) Since now I have made sure that everyone is aware of this fact, I hope to see interesting data generation and clever tricks notebooks. It's a great opportunity to earn some notebooks and datasets gold medals, go go go :)\n\n[Here is a link to an example from the data generation repo](https://github.com/arielmission-space/ExoSim2-public/blob/main/examples/example_pipeline.ipynb)",
    "3244945": "I must remind everyone of @shlomoron's wise words last year, which it seems everyone is going to have to relearn this year.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F14984949%2Fda50e27e9c2aac44f6cba5afd73444e5%2FScreenshot%202025-07-08%20194214.png?generation=1751996542864798&alt=media)",
    "3241496": "This topic this discussion I really amazed by this @shlomoron",
    "3241494": "Good to know! Time to generate some data then. Game on! thanks for this topic discussion @shlomoron ",
    "3240843": "I spent a lot of time on this last year. Still, there are a lot of things unknown when setting up the generation pipeline regarding the sensor setup and parameters. I had a very hard time getting close to the competition data, but indeed may be something for this year to try.\nThank you for bringing it up here again.",
    "3240644": "This was actually also known last year - it's just that only one team actually realized it...",
    "3241573": "Data crunching competition using many many GPU time again? 😱😱😱",
    "3240581": "2024's 5th place used Taurex3, but couldn't get clean matches, it might pay off this year",
    "3240254": "Thanks for sharing @shlomoron, more data is the secret of Yale is what i missed in last 3 months. But sharing at initial stage of competition is really helpful.",
    "3241384": "Hi, I am a beginner at kaggle competitions and I often don't understand notebooks and discussions from kaggle geniuses. Can you tell me How did you and where did you learn all these things. PS. I am a self learner , so a bit of hints and roadmaps are appreciated! TIA",
    "3243143": "Yeah its great info ",
    "3240632": "Nice sharing!\nI see someone downvoting, maybe they're not happy with this :)",
    "3240202": "```python\nIt'll probably be Ariel2024+Yale/UNC-CH on steroids. \n```\nHard! True, my 90% of the submissions end with 0.0\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F23276411%2Fdc01cade481f30e810458ef1174a8cdd%2FScreenshot%20from%202025-07-03%2020-34-17.png?generation=1751555232465597&alt=media)",
    "3240179": "I missed Yale competition. May I ask for a link?"
  }
}