{
  "id": 452813,
  "title": "Runtime limit for private test ",
  "url": "/competitions/UBC-OCEAN/discussion/452813",
  "author_name": "Nima Ashjaee",
  "post_date": "2023-11-03T15:44:00.136000",
  "votes": 4,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi all,</p>\n<p>Is there a runtime limit for private tests? The public test has a 12-hour limit for scores to be displayed, and since my inference runs take around 5 hours and the private test is approximately 5 times larger, I’m curious about any time constraints.</p>",
  "messages": [
    {
      "id": 2511915,
      "postDate": "2023-11-04T04:14:21.373Z",
      "content": "<p>When you submit your notebook, it will be tested on <strong>all</strong> data (including public dataset and private dataset), but the the leaderboard only displays your results on the public dataset. So if you submit without encountering a timeout error, there is no problem.</p>",
      "rawMarkdown": "When you submit your notebook, it will be tested on **all** data (including public dataset and private dataset), but the the leaderboard only displays your results on the public dataset. So if you submit without encountering a timeout error, there is no problem.",
      "votes": 3
    },
    {
      "id": 2511512,
      "postDate": "2023-11-03T17:53:04.460Z",
      "content": "<p>I believe if it runs on the public test set, it is good for the private test set.<br>\nI think the test set is the same in both cases but the public score is just based on a fraction of the test set</p>",
      "rawMarkdown": "I believe if it runs on the public test set, it is good for the private test set.\nI think the test set is the same in both cases but the public score is just based on a fraction of the test set",
      "votes": 3,
      "replies": [
        {
          "id": 2511918,
          "postDate": "2023-11-04T04:17:04.200Z",
          "content": "<p>i believe it too</p>",
          "rawMarkdown": "i believe it too\n"
        }
      ]
    },
    {
      "id": 2511347,
      "postDate": "2023-11-03T15:44:00.137Z",
      "content": "<p>Hi all,</p>\n<p>Is there a runtime limit for private tests? The public test has a 12-hour limit for scores to be displayed, and since my inference runs take around 5 hours and the private test is approximately 5 times larger, I’m curious about any time constraints.</p>",
      "rawMarkdown": "Hi all,\n\nIs there a runtime limit for private tests? The public test has a 12-hour limit for scores to be displayed, and since my inference runs take around 5 hours and the private test is approximately 5 times larger, I’m curious about any time constraints.",
      "votes": 4
    }
  ],
  "comments": [
    {
      "id": 2511915,
      "author_name": "m1dsolo",
      "author_url": "",
      "post_date": "2023-11-04T04:14:21.373000",
      "content": "<p>When you submit your notebook, it will be tested on <strong>all</strong> data (including public dataset and private dataset), but the the leaderboard only displays your results on the public dataset. So if you submit without encountering a timeout error, there is no problem.</p>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 2511512,
      "author_name": "KSMCG90",
      "author_url": "",
      "post_date": "2023-11-03T17:53:04.460000",
      "content": "<p>I believe if it runs on the public test set, it is good for the private test set.<br>\nI think the test set is the same in both cases but the public score is just based on a fraction of the test set</p>",
      "votes": 3,
      "replies": [
        {
          "id": 2511918,
          "author_name": "Pratyush_Ranjan",
          "author_url": "",
          "post_date": "2023-11-04T04:17:04.200000",
          "content": "<p>i believe it too</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2511915": "When you submit your notebook, it will be tested on **all** data (including public dataset and private dataset), but the the leaderboard only displays your results on the public dataset. So if you submit without encountering a timeout error, there is no problem.",
    "2511512": "I believe if it runs on the public test set, it is good for the private test set.\nI think the test set is the same in both cases but the public score is just based on a fraction of the test set",
    "2511347": "Hi all,\n\nIs there a runtime limit for private tests? The public test has a 12-hour limit for scores to be displayed, and since my inference runs take around 5 hours and the private test is approximately 5 times larger, I’m curious about any time constraints."
  }
}