{
  "id": 378836,
  "title": "Transformer training best practices",
  "url": "/competitions/rsna-breast-cancer-detection/discussion/378836",
  "author_name": "ZavodRobotov",
  "post_date": "2023-01-17T06:20:27.190000",
  "votes": 2,
  "comment_count": 1,
  "views": 0,
  "content": "<p>What are the tips &amp; tricks (and best practices) for training transformers?</p>",
  "messages": [
    {
      "id": 2106147,
      "postDate": "2023-01-19T01:53:41.637Z",
      "content": "<p>I can talk for hours about this but in general the most important details about training transformers are the batch size and learning rate.<br>\nCalibrate them heavily</p>\n<p>The Devastator.</p>",
      "rawMarkdown": "I can talk for hours about this but in general the most important details about training transformers are the batch size and learning rate.\nCalibrate them heavily\n\nThe Devastator.\n",
      "votes": 1
    },
    {
      "id": 2103323,
      "postDate": "2023-01-17T06:20:27.190Z",
      "content": "<p>What are the tips &amp; tricks (and best practices) for training transformers?</p>",
      "rawMarkdown": "What are the tips & tricks (and best practices) for training transformers?",
      "votes": 2
    }
  ],
  "comments": [
    {
      "id": 2106147,
      "author_name": "The Devastator",
      "author_url": "",
      "post_date": "2023-01-19T01:53:41.637000",
      "content": "<p>I can talk for hours about this but in general the most important details about training transformers are the batch size and learning rate.<br>\nCalibrate them heavily</p>\n<p>The Devastator.</p>",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2106147": "I can talk for hours about this but in general the most important details about training transformers are the batch size and learning rate.\nCalibrate them heavily\n\nThe Devastator.\n",
    "2103323": "What are the tips & tricks (and best practices) for training transformers?"
  }
}