{
  "id": 513320,
  "title": "Queued - Perhaps add a few more servers until all re-submission runs completed ?",
  "url": "/competitions/leap-atmospheric-physics-ai-climsim/discussion/513320",
  "author_name": "PC Jimmmy",
  "post_date": "2024-06-19T15:08:41.723000",
  "votes": 0,
  "comment_count": 3,
  "views": 0,
  "content": "<p>New personal worst - my TPU model in the queue for 10 hours and running.</p>",
  "messages": [
    {
      "id": 2896822,
      "postDate": "2024-06-30T06:31:49.110Z",
      "content": "<p>I have been trying to run a TPU notebook since yesterday with no luck. 12 hours queued, so I cancelled it and started again, and now it is at 11 hours already… </p>",
      "rawMarkdown": "I have been trying to run a TPU notebook since yesterday with no luck. 12 hours queued, so I cancelled it and started again, and now it is at 11 hours already... "
    },
    {
      "id": 2879822,
      "postDate": "2024-06-19T20:07:28.277Z",
      "content": "<p>I had no queue at all. Maybe try to submit again? Unless you mean a queue for TPU session, but you don't need to retrain your model. Just infer with GPU on the new test set.</p>",
      "rawMarkdown": "I had no queue at all. Maybe try to submit again? Unless you mean a queue for TPU session, but you don't need to retrain your model. Just infer with GPU on the new test set.",
      "replies": [
        {
          "id": 2879986,
          "postDate": "2024-06-20T00:58:06.330Z",
          "content": "<p>Sure - If I was bright enough to have saved the model - but pretty hard to see in my computer room right now = seems I am a little dim.</p>\n<p>And yes - I meant TPU queue.  Which is apparently broken as its now 20 hours.</p>",
          "rawMarkdown": "Sure - If I was bright enough to have saved the model - but pretty hard to see in my computer room right now = seems I am a little dim.\n\nAnd yes - I meant TPU queue.  Which is apparently broken as its now 20 hours."
        }
      ]
    },
    {
      "id": 2879430,
      "postDate": "2024-06-19T15:08:41.723Z",
      "content": "<p>New personal worst - my TPU model in the queue for 10 hours and running.</p>",
      "rawMarkdown": "New personal worst - my TPU model in the queue for 10 hours and running."
    }
  ],
  "comments": [
    {
      "id": 2896822,
      "author_name": "Federico Peccia",
      "author_url": "",
      "post_date": "2024-06-30T06:31:49.110000",
      "content": "<p>I have been trying to run a TPU notebook since yesterday with no luck. 12 hours queued, so I cancelled it and started again, and now it is at 11 hours already… </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 2879822,
      "author_name": "greySnow",
      "author_url": "",
      "post_date": "2024-06-19T20:07:28.277000",
      "content": "<p>I had no queue at all. Maybe try to submit again? Unless you mean a queue for TPU session, but you don't need to retrain your model. Just infer with GPU on the new test set.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 2879986,
          "author_name": "PC Jimmmy",
          "author_url": "",
          "post_date": "2024-06-20T00:58:06.330000",
          "content": "<p>Sure - If I was bright enough to have saved the model - but pretty hard to see in my computer room right now = seems I am a little dim.</p>\n<p>And yes - I meant TPU queue.  Which is apparently broken as its now 20 hours.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2896822": "I have been trying to run a TPU notebook since yesterday with no luck. 12 hours queued, so I cancelled it and started again, and now it is at 11 hours already... ",
    "2879822": "I had no queue at all. Maybe try to submit again? Unless you mean a queue for TPU session, but you don't need to retrain your model. Just infer with GPU on the new test set.",
    "2879430": "New personal worst - my TPU model in the queue for 10 hours and running."
  }
}