{
  "id": 515799,
  "title": "How to get extra data from HuggingFace?",
  "url": "/competitions/leap-atmospheric-physics-ai-climsim/discussion/515799",
  "author_name": "HideBu",
  "post_date": "2024-06-30T04:55:00.456000",
  "votes": 0,
  "comment_count": 4,
  "views": 0,
  "content": "<p>The quality and quantity of the training dataset are crucial for this competition, in my opinion.</p>\n<p>As far as I understand, we can obtain additional datasets using the Python file below and datasets available on HuggingFace:</p>\n<ul>\n<li>Python: <a href=\"https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py\" target=\"_blank\">https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py</a></li>\n<li>Dataset: <a href=\"https://huggingface.co/datasets/LEAP/ClimSim_low-res\" target=\"_blank\">https://huggingface.co/datasets/LEAP/ClimSim_low-res</a></li>\n</ul>\n<p>However, I couldn't find any target columns when I checked the <code>E3SM-MMF.mli.0001-02-01-00000.nc</code> file:<br>\n<a href=\"https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc\" target=\"_blank\">https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc</a></p>\n<p>Perhaps we need <code>E3SM-MMF.mlo.0001-02-01-00000.nc</code> additionally?</p>\n<p>Please let me know if anyone is familiar with this issue.</p>",
  "messages": [
    {
      "id": 2896852,
      "postDate": "2024-06-30T06:50:37.387Z",
      "content": "<p>mli are the input columns, mlo are the targets</p>",
      "rawMarkdown": "mli are the input columns, mlo are the targets",
      "votes": 2,
      "replies": [
        {
          "id": 2896859,
          "postDate": "2024-06-30T06:53:50.903Z",
          "content": "<p>Thank you for reply.<br>\nI would like to know where could I get mlo file. I cannot find it. 😢</p>",
          "rawMarkdown": "Thank you for reply.\nI would like to know where could I get mlo file. I cannot find it. 😢",
          "replies": [
            {
              "id": 2897009,
              "postDate": "2024-06-30T07:57:16.907Z",
              "content": "<p>Just change in your link mli to mlo:<br>\n<a href=\"https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mlo.0001-02-01-00000.nc\" target=\"_blank\">https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mlo.0001-02-01-00000.nc</a></p>",
              "rawMarkdown": "Just change in your link mli to mlo:\nhttps://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mlo.0001-02-01-00000.nc",
              "votes": 2
            },
            {
              "id": 2897078,
              "postDate": "2024-06-30T08:34:52.660Z",
              "content": "<p>Oh. Thanks!!<br>\nI will try. I appreciate your kindness👍</p>",
              "rawMarkdown": "Oh. Thanks!!\nI will try. I appreciate your kindness👍",
              "votes": 1
            }
          ]
        }
      ]
    },
    {
      "id": 2896743,
      "postDate": "2024-06-30T04:55:00.457Z",
      "content": "<p>The quality and quantity of the training dataset are crucial for this competition, in my opinion.</p>\n<p>As far as I understand, we can obtain additional datasets using the Python file below and datasets available on HuggingFace:</p>\n<ul>\n<li>Python: <a href=\"https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py\" target=\"_blank\">https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py</a></li>\n<li>Dataset: <a href=\"https://huggingface.co/datasets/LEAP/ClimSim_low-res\" target=\"_blank\">https://huggingface.co/datasets/LEAP/ClimSim_low-res</a></li>\n</ul>\n<p>However, I couldn't find any target columns when I checked the <code>E3SM-MMF.mli.0001-02-01-00000.nc</code> file:<br>\n<a href=\"https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc\" target=\"_blank\">https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc</a></p>\n<p>Perhaps we need <code>E3SM-MMF.mlo.0001-02-01-00000.nc</code> additionally?</p>\n<p>Please let me know if anyone is familiar with this issue.</p>",
      "rawMarkdown": "The quality and quantity of the training dataset are crucial for this competition, in my opinion.\n\nAs far as I understand, we can obtain additional datasets using the Python file below and datasets available on HuggingFace:\n- Python: [https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py](https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py)\n- Dataset: [https://huggingface.co/datasets/LEAP/ClimSim_low-res](https://huggingface.co/datasets/LEAP/ClimSim_low-res)\n\nHowever, I couldn't find any target columns when I checked the `E3SM-MMF.mli.0001-02-01-00000.nc` file:\n[https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc](https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc)\n\nPerhaps we need `E3SM-MMF.mlo.0001-02-01-00000.nc` additionally?\n\nPlease let me know if anyone is familiar with this issue."
    }
  ],
  "comments": [
    {
      "id": 2896852,
      "author_name": "Federico Peccia",
      "author_url": "",
      "post_date": "2024-06-30T06:50:37.387000",
      "content": "<p>mli are the input columns, mlo are the targets</p>",
      "votes": 2,
      "replies": [
        {
          "id": 2896859,
          "author_name": "HideBu",
          "author_url": "",
          "post_date": "2024-06-30T06:53:50.903000",
          "content": "<p>Thank you for reply.<br>\nI would like to know where could I get mlo file. I cannot find it. 😢</p>",
          "votes": 0,
          "replies": [
            {
              "id": 2897009,
              "author_name": "greySnow",
              "author_url": "",
              "post_date": "2024-06-30T07:57:16.907000",
              "content": "<p>Just change in your link mli to mlo:<br>\n<a href=\"https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mlo.0001-02-01-00000.nc\" target=\"_blank\">https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mlo.0001-02-01-00000.nc</a></p>",
              "votes": 2,
              "replies": []
            },
            {
              "id": 2897078,
              "author_name": "HideBu",
              "author_url": "",
              "post_date": "2024-06-30T08:34:52.660000",
              "content": "<p>Oh. Thanks!!<br>\nI will try. I appreciate your kindness👍</p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2896852": "mli are the input columns, mlo are the targets",
    "2896743": "The quality and quantity of the training dataset are crucial for this competition, in my opinion.\n\nAs far as I understand, we can obtain additional datasets using the Python file below and datasets available on HuggingFace:\n- Python: [https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py](https://github.com/leap-stc/ClimSim/blob/main/for_kaggle_users.py)\n- Dataset: [https://huggingface.co/datasets/LEAP/ClimSim_low-res](https://huggingface.co/datasets/LEAP/ClimSim_low-res)\n\nHowever, I couldn't find any target columns when I checked the `E3SM-MMF.mli.0001-02-01-00000.nc` file:\n[https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc](https://huggingface.co/datasets/LEAP/ClimSim_low-res/blob/main/train/0001-02/E3SM-MMF.mli.0001-02-01-00000.nc)\n\nPerhaps we need `E3SM-MMF.mlo.0001-02-01-00000.nc` additionally?\n\nPlease let me know if anyone is familiar with this issue."
  }
}