{
  "id": 112198,
  "title": "How to avoid ZeroDivisionError: float division by zero error?",
  "url": "/competitions/rsna-intracranial-hemorrhage-detection/discussion/112198",
  "author_name": "Mobassir",
  "post_date": "2019-10-11T10:26:14.588000",
  "votes": 7,
  "comment_count": 11,
  "views": 0,
  "content": "<p>I was trying this model in google colab : <a href=\"https://www.kaggle.com/taindow/pytorch-resnext-101-32x8d-benchmark\">https://www.kaggle.com/taindow/pytorch-resnext-101-32x8d-benchmark</a></p>\n\n<p>i reduced the size of the data so colab doesn't crash and also reduced the batch size down to 32 but after almost 2 hours model training i get this error : \n<strong>ZeroDivisionError: float division by zero</strong></p>\n\n<p>i understand why this error is happening but can't understand what to do to solve this error? is it because batch size = 32 and not 64?</p>\n\n<p>here is my model log : </p>\n\n<h2>Epoch 0/0</h2>\n\n<p>Iteration\n5% 1091/20994 [43:46&lt;13:17:55, 2.41s/it]</p>\n\n<p>Gradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32768.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16384.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8192.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4096.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2048.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1024.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 512.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 256.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 128.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 64.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.5\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.03125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.015625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0078125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00390625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.001953125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0009765625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00048828125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.000244140625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0001220703125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.103515625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0517578125e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.52587890625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.62939453125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.814697265625e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9073486328125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5367431640625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.76837158203125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.384185791015625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1920928955078125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.960464477539063e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9802322387695312e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4901161193847656e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.450580596923828e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.725290298461914e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.862645149230957e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.313225746154785e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.656612873077393e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3283064365386963e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1641532182693481e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.820766091346741e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9103830456733704e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4551915228366852e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.275957614183426e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.637978807091713e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8189894035458565e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.094947017729282e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.547473508864641e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2737367544323206e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1368683772161603e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.684341886080802e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.842170943040401e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4210854715202004e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.105427357601002e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.552713678800501e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7763568394002505e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.881784197001252e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.440892098500626e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.220446049250313e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1102230246251565e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.551115123125783e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7755575615628914e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3877787807814457e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.938893903907228e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.469446951953614e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.734723475976807e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.673617379884035e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.336808689942018e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.168404344971009e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0842021724855044e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.421010862427522e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.710505431213761e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3552527156068805e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.776263578034403e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3881317890172014e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6940658945086007e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.470329472543003e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.235164736271502e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.117582368135751e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0587911840678754e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.293955920339377e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6469779601696886e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3234889800848443e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.617444900424222e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.308722450212111e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6543612251060553e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.271806125530277e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1359030627651384e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0679515313825692e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0339757656912846e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.169878828456423e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5849394142282115e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2924697071141057e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.462348535570529e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2311742677852644e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6155871338926322e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.077935669463161e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0389678347315804e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0194839173657902e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0097419586828951e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.048709793414476e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.524354896707238e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.262177448353619e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.310887241768095e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1554436208840472e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5777218104420236e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.888609052210118e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.944304526105059e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9721522630525295e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.860761315262648e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.930380657631324e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.465190328815662e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.232595164407831e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.162975822039155e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0814879110195774e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5407439555097887e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.703719777548943e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.851859888774472e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.925929944387236e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.62964972193618e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.81482486096809e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.407412430484045e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2037062152420224e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.018531076210112e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.009265538105056e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.504632769052528e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.52316384526264e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.76158192263132e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.88079096131566e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.4039548065783e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.70197740328915e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.350988701644575e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1754943508222875e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.877471754111438e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.938735877055719e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4693679385278594e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.346839692639297e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6734198463196485e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8367099231598242e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.183549615799121e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.591774807899561e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2958874039497803e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1479437019748901e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.739718509874451e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8698592549372254e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4349296274686127e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.174648137343064e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.587324068671532e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.793662034335766e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.96831017167883e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.484155085839415e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2420775429197073e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1210387714598537e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.605193857299268e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.802596928649634e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.401298464324817e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.006492321624085e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.503246160812043e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7516230804060213e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.758115402030107e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3790577010150533e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1895288505075267e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0947644252537633e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.473822126268817e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7369110631344083e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3684555315672042e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.842277657836021e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4211388289180104e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7105694144590052e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.552847072295026e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.276423536147513e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1382117680737565e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0691058840368783e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.345529420184391e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6727647100921956e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3363823550460978e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.681911775230489e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3409558876152446e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6704779438076223e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.352389719038111e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.176194859519056e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.088097429759528e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.044048714879764e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.22024357439882e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.61012178719941e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.305060893599705e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.525304467998525e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2626522339992623e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6313261169996311e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.156630584998156e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.078315292499078e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.039157646249539e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0195788231247695e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0978941156238473e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5489470578119236e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2744735289059618e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.372367644529809e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1861838222649046e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5930919111324523e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.965459555662261e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.982729777831131e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9913648889155653e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.956824444577827e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9784122222889134e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4892061111444567e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2446030555722283e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.223015277861142e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.111507638930571e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5557538194652854e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.778769097326427e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8893845486632136e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9446922743316068e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.723461371658034e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.861730685829017e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4308653429145085e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2154326714572542e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.077163357286271e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0385816786431356e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5192908393215678e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.596454196607839e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7982270983039195e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8991135491519597e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.495567745759799e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7477838728798994e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3738919364399497e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1869459682199748e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.934729841099874e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.967364920549937e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4836824602749686e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.418412301374843e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7092061506874214e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8546030753437107e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.273015376718553e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.636507688359277e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3182538441796384e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1591269220898192e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.795634610449096e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.897817305224548e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.448908652612274e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.24454326306137e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.622271631530685e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8111358157653425e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.055679078826712e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.527839539413356e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.263919769706678e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.131959884853339e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.659799424266695e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8298997121333476e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4149498560666738e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.074749280333369e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5373746401666845e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7686873200833423e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.843436600416711e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.421718300208356e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.210859150104178e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.105429575052089e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.527147875260445e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7635739376302223e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3817869688151111e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.908934844075556e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.454467422037778e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.727233711018889e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.636168555094445e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3180842775472223e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1590421387736112e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0795210693868056e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.397605346934028e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.698802673467014e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.349401336733507e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.747006683667535e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3735033418337674e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6867516709168837e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.433758354584419e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2168791772922093e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1084395886461046e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0542197943230523e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.271098971615262e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.635549485807631e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3177747429038154e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.588873714519077e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2944368572595385e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6472184286297693e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.236092143148846e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.118046071574423e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0590230357872116e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0295115178936058e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.147557589468029e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5737787947340145e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2868893973670072e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.434446986835036e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.217223493417518e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.608611746708759e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.043058733543795e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.021529366771898e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.010764683385949e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0053823416929744e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.026911708464872e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.513455854232436e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.256727927116218e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.28363963558109e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.141819817790545e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5709099088952725e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.854549544476363e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9272747722381812e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9636373861190906e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.818186930595453e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.909093465297727e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4545467326488633e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2272733663244316e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.136366831622158e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.068183415811079e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5340917079055395e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.670458539527698e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.835229269763849e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9176146348819244e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.588073174409622e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.794036587204811e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3970182936024055e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1985091468012028e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.992545734006014e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.996272867003007e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4981364335015035e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.490682167507517e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.745341083753759e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8726705418768793e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.363352709384397e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6816763546921983e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3408381773460992e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1704190886730496e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.852095443365248e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.926047721682624e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.463023860841312e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.31511930420656e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.65755965210328e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.82877982605164e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.1438991302582e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5719495651291e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.28597478256455e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.142987391282275e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.714936956411375e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8574684782056875e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4287342391028437e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.143671195514219e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5718355977571093e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7859177988785547e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.929588994392773e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.464794497196387e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2323972485981933e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1161986242990967e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5809931214954833e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7904965607477417e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3952482803738708e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.976241401869354e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.488120700934677e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7440603504673385e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.720301752336693e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3601508761683463e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1800754380841732e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0900377190420866e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.450188595210433e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7250942976052165e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3625471488026082e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.812735744013041e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4063678720065206e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7031839360032603e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.515919680016301e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.257959840008151e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1289799200040754e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0644899600020377e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.3224498000101884e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6612249000050942e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3306124500025471e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.653062250012736e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.326531125006368e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.663265562503184e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.31632781251592e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.15816390625796e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.07908195312898e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.03954097656449e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.19770488282245e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.598852441411225e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2994262207056124e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.497131103528062e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.248565551764031e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6242827758820155e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.121413879410078e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.060706939705039e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0303534698525194e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0151767349262597e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.075883674631299e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5379418373156492e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2689709186578246e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.344854593289123e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1724272966445615e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5862136483222808e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.931068241611404e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.965534120805702e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.982767060402851e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.913835302014255e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9569176510071274e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4784588255035637e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2392294127517818e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.196147063758909e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0980735318794546e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5490367659397273e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.745183829698637e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8725919148493183e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9362959574246591e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.681479787123296e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.840739893561648e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.420369946780824e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.210184973390412e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.05092486695206e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.02546243347603e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.512731216738015e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.563656083690075e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7818280418450374e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8909140209225187e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.454570104612593e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.727285052306297e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3636425261531484e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1818212630765742e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.909106315382871e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9545531576914354e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4772765788457177e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.386382894228589e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6931914471142943e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8465957235571472e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.232978617785736e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.616489308892868e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.308244654446434e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.154122327223217e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.770611636116085e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8853058180580424e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4426529090290212e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.213264545145106e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.606632272572553e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8033161362862765e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.016580681431383e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5082903407156913e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2541451703578456e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1270725851789228e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.635362925894614e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.817681462947307e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4088407314736535e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.044203657368268e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.522101828684134e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.761050914342067e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.805254571710335e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4026272858551673e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2013136429275836e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1006568214637918e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.503284107318959e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7516420536594796e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3758210268297398e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.879105134148699e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4395525670743494e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7197762835371747e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.598881417685874e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.299440708842937e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1497203544214684e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0748601772107342e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.374300886053671e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6871504430268355e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3435752215134178e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.717876107567089e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3589380537835444e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6794690268917722e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.397345134458861e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1986725672294305e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0993362836147152e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0496681418073576e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.248340709036788e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.624170354518394e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.312085177259197e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.560425886295985e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2802129431479926e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6401064715739963e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.200532357869981e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.100266178934991e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0501330894674953e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0250665447337477e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1253327236687384e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5626663618343692e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2813331809171846e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.406665904585923e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2033329522929615e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6016664761464807e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.008332380732404e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.004166190366202e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.002083095183101e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0010415475915505e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0052077379577523e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5026038689788762e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2513019344894381e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.256509672447191e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1282548362235952e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5641274181117976e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.820637090558988e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.910318545279494e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.955159272639747e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.775796363198735e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.887898181599368e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.443949090799684e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.221974545399842e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.10987272699921e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.054936363499605e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5274681817498023e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.637340908749012e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.818670454374506e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.909335227187253e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.546676135936265e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7733380679681323e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3866690339840662e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1933345169920331e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.966672584960166e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.983336292480083e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4916681462400413e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.458340731200207e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7291703656001034e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8645851828000517e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.322925914000258e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.661462957000129e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3307314785000646e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1653657392500323e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.826828696250162e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.913414348125081e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4567071740625404e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.283535870312702e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.641767935156351e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8208839675781755e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.104419837890877e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.552209918945439e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2761049594727193e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1380524797363597e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.6902623986817984e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8451311993408992e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4225655996704496e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.112827998352248e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.556413999176124e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.778206999588062e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.89103499794031e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.445517498970155e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2227587494850775e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1113793747425387e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.556896873712694e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.778448436856347e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3892242184281734e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.946121092140867e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4730605460704336e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7365302730352168e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.682651365176084e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.341325682588042e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.170662841294021e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0853314206470105e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.426657103235053e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7133285516175262e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3566642758087631e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.783321379043816e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.391660689521908e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.695830344760954e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.47915172380477e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.239575861902385e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1197879309511924e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0598939654755962e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.299469827377981e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6497349136889905e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3248674568444952e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.624337284222476e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.312168642111238e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.656084321055619e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.280421605278095e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.140210802639048e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.070105401319524e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.035052700659762e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.17526350329881e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.587631751649405e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2938158758247024e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.469079379123512e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.234539689561756e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.617269844780878e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.08634922390439e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.043174611952195e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0215873059760975e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0107936529880487e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.053968264940244e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.526984132470122e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.263492066235061e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.317460331175305e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1587301655876523e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5793650827938261e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.896825413969131e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9484127069845653e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9742063534922827e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.871031767461413e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.935515883730707e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4677579418653533e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2338789709326767e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.169394854663383e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.084697427331692e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.542348713665846e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.71174356832923e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.855871784164615e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9279358920823073e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.639679460411536e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.819839730205768e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.409919865102884e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.204959932551442e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.02479966275721e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.012399831378605e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5061999156893026e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.530999578446513e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7654997892232564e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8827498946116282e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.413749473058141e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.706874736529071e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3534373682645353e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1767186841322676e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.883593420661338e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.941796710330669e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4708983551653345e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.354491775826673e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6772458879133364e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8386229439566682e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.193114719783341e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5965573598916705e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2982786799458352e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1491393399729176e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.745696699864588e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.872848349932294e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.436424174966147e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.182120874830735e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5910604374153675e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7955302187076838e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.977651093538419e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4888255467692094e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2444127733846047e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1222063866923024e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.611031933461512e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.805515966730756e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.402757983365378e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.01378991682689e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.506894958413445e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7534474792067224e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.767237396033612e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.383618698016806e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.191809349008403e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0959046745042015e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.479523372521008e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.739761686260504e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.369880843130252e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.84940421565126e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.42470210782563e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.712351053912815e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.561755269564074e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.280877634782037e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1404388173910186e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0702194086955093e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.351097043477547e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6755485217387732e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3377742608693866e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.688871304346933e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3444356521734666e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6722178260867333e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.361089130433666e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.180544565216833e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0902722826084166e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0451361413042083e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.225680706521042e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.612840353260521e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3064201766302604e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.532100883151302e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.266050441575651e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6330252207878255e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.165126103939127e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.082563051969564e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.041281525984782e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.020640762992391e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.103203814961955e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5516019074809773e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2758009537404886e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.379004768702443e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1895023843512216e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5947511921756108e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.973755960878054e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.986877980439027e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9934389902195135e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.967194951097568e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.983597475548784e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.491798737774392e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.245899368887196e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.22949684443598e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.11474842221799e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.557374211108995e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.786871055544975e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8934355277724873e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9467177638862437e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.733588819431218e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.866794409715609e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4333972048578046e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2166986024289023e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.083493012144512e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.041746506072256e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.520873253036128e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.60436626518064e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.80218313259032e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.90109156629516e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5054578314758e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7527289157379e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.37636445786895e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.188182228934475e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.940911144672375e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9704555723361872e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4852277861680936e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.426138930840468e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.713069465420234e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.856534732710117e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.282673663550585e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.641336831775293e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3206684158876463e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1603342079438231e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.801671039719116e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.900835519859558e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.450417759929779e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.252088799648895e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6260443998244473e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8130221999122236e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.065110999561118e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.532555499780559e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2662777498902796e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1331388749451398e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.665694374725699e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8328471873628494e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4164235936814247e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.082117968407124e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.541058984203562e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.770529492101781e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.852647460508905e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4263237302544523e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2131618651272261e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1065809325636131e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5329046628180653e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7664523314090327e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3832261657045163e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.916130828522582e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.458065414261291e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7290327071306454e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.645163535653227e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.322581767826614e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.161290883913307e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0806454419566534e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.403227209783267e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7016136048916335e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3508068024458167e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.754034012229084e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.377017006114542e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.688508503057271e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.442542515286355e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2212712576431773e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1106356288215886e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0553178144107943e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.276589072053972e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.638294536026986e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.319147268013493e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.595736340067465e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2978681700337323e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6489340850168661e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.244670425084331e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1223352125421653e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0611676062710827e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0305838031355413e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.152919015677707e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5764595078388533e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2882297539194267e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.441148769597133e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.220574384798567e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6102871923992833e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.051435961996417e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0257179809982083e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0128589904991042e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0064294952495521e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0321474762477604e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5160737381238802e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2580368690619401e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.290184345309701e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1450921726548502e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5725460863274251e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.862730431637126e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.931365215818563e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9656826079092814e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.828413039546407e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.914206519773204e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.457103259886602e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.228551629943301e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.142758149716505e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0713790748582522e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5356895374291261e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.678447687145631e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8392238435728152e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9196119217864076e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.598059608932038e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.799029804466019e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3995149022330095e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1997574511165048e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.998787255582524e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.999393627791262e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.499696813895631e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.498484069478155e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7492420347390774e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8746210173695387e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.373105086847693e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.686552543423847e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3432762717119234e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1716381358559617e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.858190679279809e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9290953396399042e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4645476698199521e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.322738349099761e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6613691745498803e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8306845872749401e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.153422936374701e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5767114681873503e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2883557340936752e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1441778670468376e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.720889335234188e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.860444667617094e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.430222333808547e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.151111669042735e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5755558345213674e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7877779172606837e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.938889586303419e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4694447931517093e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2347223965758547e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1173611982879273e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.586805991439637e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7934029957198183e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3967014978599092e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.983507489299546e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.491753744649773e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7458768723248864e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.729384361624432e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.364692180812216e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.182346090406108e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.091173045203054e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.45586522601527e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.727932613007635e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3639663065038175e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.819831532519088e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.409915766259544e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.704957883129772e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.52478941564886e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.26239470782443e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.131197353912215e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0655986769561075e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.327993384780537e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6639966923902686e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3319983461951343e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.659991730975672e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.329995865487836e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.664997932743918e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.32498966371959e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.162494831859795e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0812474159298974e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0406237079649487e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.2031185398247434e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6015592699123717e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3007796349561859e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.503898174780929e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2519490873904646e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6259745436952323e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.129872718476162e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.064936359238081e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0324681796190404e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0162340898095202e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.081170449047601e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5405852245238005e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2702926122619002e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.351463061309501e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1757315306547506e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5878657653273753e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.939328826636877e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9696644133184383e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9848322066592191e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.924161033296096e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.962080516648048e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.481040258324024e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.240520129162012e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.20260064581006e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.10130032290503e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.550650161452515e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.753250807262575e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8766254036312874e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9383127018156437e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.691563509078218e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.845781754539109e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4228908772695546e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2114454386347773e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.057227193173887e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0286135965869433e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5143067982934716e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.571533991467358e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.785766995733679e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8928834978668395e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.464417489334198e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.732208744667099e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3661043723335494e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1830521861667747e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.915260930833874e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.957630465416937e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4788152327084684e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.394076163542342e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.697038081771171e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8485190408855855e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.242595204427927e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.621297602213964e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.310648801106982e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.155324400553491e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.776622002767455e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8883110013837273e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4441555006918637e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.220777503459318e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.610388751729659e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8051943758648296e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.025971879324148e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.512985939662074e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.256492969831037e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1282464849155185e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.641232424577593e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8206162122887962e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4103081061443981e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.051540530721991e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5257702653609953e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7628851326804976e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.814425663402488e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.407212831701244e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.203606415850622e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.101803207925311e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.509016039626555e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7545080198132776e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3772540099066388e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.886270049533194e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.443135024766597e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7215675123832985e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.607837561916492e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.303918780958246e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.151959390479123e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0759796952395615e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.379898476197808e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.689949238098904e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.344974619049452e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.72487309524726e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.36243654762363e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.681218273811815e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.406091369059075e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2030456845295373e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1015228422647686e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0507614211323843e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.253807105661922e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.626903552830961e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3134517764154804e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.567258882077402e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.283629441038701e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6418147205193505e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.209073602596753e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1045368012983762e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0522684006491881e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0261342003245941e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1306710016229703e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5653355008114852e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2826677504057426e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.413338752028713e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2066693760143564e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6033346880071782e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.016673440035891e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.008336720017946e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.004168360008973e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0020841800044864e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.010420900022432e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.505210450011216e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.252605225005608e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.26302612502804e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.13151306251402e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.56575653125701e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.82878265628505e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.914391328142525e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9571956640712625e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.785978320356312e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.892989160178156e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.446494580089078e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.223247290044539e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.116236450222695e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0581182251113476e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5290591125556738e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.645295562778369e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8226477813891845e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9113238906945923e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.556619453472961e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.778309726736481e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3891548633682403e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1945774316841202e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.972887158420601e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9864435792103004e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4932217896051502e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.466108948025751e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7330544740128755e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8665272370064378e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.332636185032189e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6663180925160944e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3331590462580472e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1665795231290236e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.832897615645118e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.916448807822559e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4582244039112795e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.291122019556398e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.645561009778199e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8227805048890994e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.113902524445497e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5569512622227484e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2784756311113742e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1392378155556871e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.696189077778436e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.848094538889218e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.424047269444609e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.120236347223045e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5601181736115222e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7800590868057611e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.900295434028806e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.450147717014403e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2250738585072014e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1125369292536007e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.562684646268003e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.781342323134e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.390671161567e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.953355807835e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4766779039175e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.73833895195875e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.691694759794e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.345847379897e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1729236899484e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.086461844974e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.43230922487e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.716154612436e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.35807730622e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.7903865311e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.39519326554e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.69759663277e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.487983164e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.243991582e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.121995791e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0609978955e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.304989477e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.65249474e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.32624737e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.63123685e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3156184e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6578092e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.289046e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.144523e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0722615e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.036131e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.180654e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.590327e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.295163e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.4758e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2379e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.61895e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.095e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0474e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0237e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.012e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.06e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.53e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.265e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.3e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.16e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5e-324\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0</p>\n\n<hr>\n\n<p>ZeroDivisionError                         Traceback (most recent call last)</p>",
  "messages": [
    {
      "id": 646493,
      "postDate": "2019-10-11T10:26:14.590Z",
      "content": "<p>I was trying this model in google colab : <a href=\"https://www.kaggle.com/taindow/pytorch-resnext-101-32x8d-benchmark\">https://www.kaggle.com/taindow/pytorch-resnext-101-32x8d-benchmark</a></p>\n\n<p>i reduced the size of the data so colab doesn't crash and also reduced the batch size down to 32 but after almost 2 hours model training i get this error : \n<strong>ZeroDivisionError: float division by zero</strong></p>\n\n<p>i understand why this error is happening but can't understand what to do to solve this error? is it because batch size = 32 and not 64?</p>\n\n<p>here is my model log : </p>\n\n<h2>Epoch 0/0</h2>\n\n<p>Iteration\n5% 1091/20994 [43:46&lt;13:17:55, 2.41s/it]</p>\n\n<p>Gradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32768.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16384.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8192.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4096.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2048.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1024.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 512.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 256.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 128.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 64.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.5\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.03125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.015625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0078125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00390625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.001953125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0009765625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00048828125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.000244140625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0001220703125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.103515625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0517578125e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.52587890625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.62939453125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.814697265625e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9073486328125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5367431640625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.76837158203125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.384185791015625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1920928955078125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.960464477539063e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9802322387695312e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4901161193847656e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.450580596923828e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.725290298461914e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.862645149230957e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.313225746154785e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.656612873077393e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3283064365386963e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1641532182693481e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.820766091346741e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9103830456733704e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4551915228366852e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.275957614183426e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.637978807091713e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8189894035458565e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.094947017729282e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.547473508864641e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2737367544323206e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1368683772161603e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.684341886080802e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.842170943040401e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4210854715202004e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.105427357601002e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.552713678800501e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7763568394002505e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.881784197001252e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.440892098500626e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.220446049250313e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1102230246251565e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.551115123125783e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7755575615628914e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3877787807814457e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.938893903907228e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.469446951953614e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.734723475976807e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.673617379884035e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.336808689942018e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.168404344971009e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0842021724855044e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.421010862427522e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.710505431213761e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3552527156068805e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.776263578034403e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3881317890172014e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6940658945086007e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.470329472543003e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.235164736271502e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.117582368135751e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0587911840678754e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.293955920339377e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6469779601696886e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3234889800848443e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.617444900424222e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.308722450212111e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6543612251060553e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.271806125530277e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1359030627651384e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0679515313825692e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0339757656912846e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.169878828456423e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5849394142282115e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2924697071141057e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.462348535570529e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2311742677852644e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6155871338926322e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.077935669463161e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0389678347315804e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0194839173657902e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0097419586828951e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.048709793414476e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.524354896707238e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.262177448353619e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.310887241768095e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1554436208840472e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5777218104420236e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.888609052210118e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.944304526105059e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9721522630525295e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.860761315262648e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.930380657631324e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.465190328815662e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.232595164407831e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.162975822039155e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0814879110195774e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5407439555097887e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.703719777548943e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.851859888774472e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.925929944387236e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.62964972193618e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.81482486096809e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.407412430484045e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2037062152420224e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.018531076210112e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.009265538105056e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.504632769052528e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.52316384526264e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.76158192263132e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.88079096131566e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.4039548065783e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.70197740328915e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.350988701644575e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1754943508222875e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.877471754111438e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.938735877055719e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4693679385278594e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.346839692639297e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6734198463196485e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8367099231598242e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.183549615799121e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.591774807899561e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2958874039497803e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1479437019748901e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.739718509874451e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8698592549372254e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4349296274686127e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.174648137343064e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.587324068671532e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.793662034335766e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.96831017167883e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.484155085839415e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2420775429197073e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1210387714598537e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.605193857299268e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.802596928649634e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.401298464324817e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.006492321624085e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.503246160812043e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7516230804060213e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.758115402030107e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3790577010150533e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1895288505075267e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0947644252537633e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.473822126268817e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7369110631344083e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3684555315672042e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.842277657836021e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4211388289180104e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7105694144590052e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.552847072295026e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.276423536147513e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1382117680737565e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0691058840368783e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.345529420184391e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6727647100921956e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3363823550460978e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.681911775230489e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3409558876152446e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6704779438076223e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.352389719038111e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.176194859519056e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.088097429759528e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.044048714879764e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.22024357439882e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.61012178719941e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.305060893599705e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.525304467998525e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2626522339992623e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6313261169996311e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.156630584998156e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.078315292499078e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.039157646249539e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0195788231247695e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0978941156238473e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5489470578119236e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2744735289059618e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.372367644529809e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1861838222649046e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5930919111324523e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.965459555662261e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.982729777831131e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9913648889155653e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.956824444577827e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9784122222889134e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4892061111444567e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2446030555722283e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.223015277861142e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.111507638930571e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5557538194652854e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.778769097326427e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8893845486632136e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9446922743316068e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.723461371658034e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.861730685829017e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4308653429145085e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2154326714572542e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.077163357286271e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0385816786431356e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5192908393215678e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.596454196607839e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7982270983039195e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8991135491519597e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.495567745759799e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7477838728798994e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3738919364399497e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1869459682199748e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.934729841099874e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.967364920549937e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4836824602749686e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.418412301374843e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7092061506874214e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8546030753437107e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.273015376718553e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.636507688359277e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3182538441796384e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1591269220898192e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.795634610449096e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.897817305224548e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.448908652612274e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.24454326306137e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.622271631530685e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8111358157653425e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.055679078826712e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.527839539413356e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.263919769706678e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.131959884853339e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.659799424266695e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8298997121333476e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4149498560666738e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.074749280333369e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5373746401666845e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7686873200833423e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.843436600416711e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.421718300208356e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.210859150104178e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.105429575052089e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.527147875260445e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7635739376302223e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3817869688151111e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.908934844075556e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.454467422037778e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.727233711018889e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.636168555094445e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3180842775472223e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1590421387736112e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0795210693868056e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.397605346934028e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.698802673467014e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.349401336733507e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.747006683667535e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3735033418337674e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6867516709168837e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.433758354584419e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2168791772922093e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1084395886461046e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0542197943230523e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.271098971615262e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.635549485807631e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3177747429038154e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.588873714519077e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2944368572595385e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6472184286297693e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.236092143148846e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.118046071574423e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0590230357872116e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0295115178936058e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.147557589468029e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5737787947340145e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2868893973670072e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.434446986835036e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.217223493417518e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.608611746708759e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.043058733543795e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.021529366771898e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.010764683385949e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0053823416929744e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.026911708464872e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.513455854232436e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.256727927116218e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.28363963558109e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.141819817790545e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5709099088952725e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.854549544476363e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9272747722381812e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9636373861190906e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.818186930595453e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.909093465297727e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4545467326488633e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2272733663244316e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.136366831622158e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.068183415811079e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5340917079055395e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.670458539527698e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.835229269763849e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9176146348819244e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.588073174409622e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.794036587204811e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3970182936024055e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1985091468012028e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.992545734006014e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.996272867003007e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4981364335015035e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.490682167507517e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.745341083753759e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8726705418768793e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.363352709384397e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6816763546921983e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3408381773460992e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1704190886730496e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.852095443365248e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.926047721682624e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.463023860841312e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.31511930420656e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.65755965210328e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.82877982605164e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.1438991302582e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5719495651291e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.28597478256455e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.142987391282275e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.714936956411375e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8574684782056875e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4287342391028437e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.143671195514219e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5718355977571093e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7859177988785547e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.929588994392773e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.464794497196387e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2323972485981933e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1161986242990967e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5809931214954833e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7904965607477417e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3952482803738708e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.976241401869354e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.488120700934677e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7440603504673385e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.720301752336693e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3601508761683463e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1800754380841732e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0900377190420866e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.450188595210433e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7250942976052165e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3625471488026082e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.812735744013041e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4063678720065206e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7031839360032603e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.515919680016301e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.257959840008151e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1289799200040754e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0644899600020377e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.3224498000101884e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6612249000050942e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3306124500025471e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.653062250012736e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.326531125006368e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.663265562503184e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.31632781251592e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.15816390625796e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.07908195312898e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.03954097656449e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.19770488282245e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.598852441411225e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2994262207056124e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.497131103528062e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.248565551764031e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6242827758820155e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.121413879410078e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.060706939705039e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0303534698525194e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0151767349262597e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.075883674631299e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5379418373156492e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2689709186578246e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.344854593289123e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1724272966445615e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5862136483222808e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.931068241611404e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.965534120805702e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.982767060402851e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.913835302014255e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9569176510071274e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4784588255035637e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2392294127517818e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.196147063758909e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0980735318794546e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5490367659397273e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.745183829698637e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8725919148493183e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9362959574246591e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.681479787123296e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.840739893561648e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.420369946780824e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.210184973390412e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.05092486695206e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.02546243347603e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.512731216738015e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.563656083690075e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7818280418450374e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8909140209225187e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.454570104612593e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.727285052306297e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3636425261531484e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1818212630765742e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.909106315382871e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9545531576914354e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4772765788457177e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.386382894228589e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6931914471142943e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8465957235571472e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.232978617785736e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.616489308892868e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.308244654446434e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.154122327223217e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.770611636116085e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8853058180580424e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4426529090290212e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.213264545145106e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.606632272572553e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8033161362862765e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.016580681431383e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5082903407156913e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2541451703578456e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1270725851789228e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.635362925894614e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.817681462947307e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4088407314736535e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.044203657368268e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.522101828684134e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.761050914342067e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.805254571710335e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4026272858551673e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2013136429275836e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1006568214637918e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.503284107318959e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7516420536594796e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3758210268297398e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.879105134148699e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4395525670743494e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7197762835371747e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.598881417685874e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.299440708842937e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1497203544214684e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0748601772107342e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.374300886053671e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6871504430268355e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3435752215134178e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.717876107567089e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3589380537835444e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6794690268917722e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.397345134458861e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1986725672294305e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0993362836147152e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0496681418073576e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.248340709036788e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.624170354518394e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.312085177259197e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.560425886295985e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2802129431479926e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6401064715739963e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.200532357869981e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.100266178934991e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0501330894674953e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0250665447337477e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1253327236687384e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5626663618343692e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2813331809171846e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.406665904585923e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2033329522929615e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6016664761464807e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.008332380732404e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.004166190366202e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.002083095183101e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0010415475915505e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0052077379577523e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5026038689788762e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2513019344894381e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.256509672447191e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1282548362235952e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5641274181117976e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.820637090558988e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.910318545279494e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.955159272639747e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.775796363198735e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.887898181599368e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.443949090799684e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.221974545399842e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.10987272699921e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.054936363499605e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5274681817498023e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.637340908749012e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.818670454374506e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.909335227187253e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.546676135936265e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7733380679681323e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3866690339840662e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1933345169920331e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.966672584960166e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.983336292480083e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4916681462400413e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.458340731200207e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7291703656001034e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8645851828000517e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.322925914000258e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.661462957000129e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3307314785000646e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1653657392500323e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.826828696250162e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.913414348125081e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4567071740625404e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.283535870312702e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.641767935156351e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8208839675781755e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.104419837890877e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.552209918945439e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2761049594727193e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1380524797363597e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.6902623986817984e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8451311993408992e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4225655996704496e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.112827998352248e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.556413999176124e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.778206999588062e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.89103499794031e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.445517498970155e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2227587494850775e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1113793747425387e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.556896873712694e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.778448436856347e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3892242184281734e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.946121092140867e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4730605460704336e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7365302730352168e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.682651365176084e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.341325682588042e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.170662841294021e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0853314206470105e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.426657103235053e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7133285516175262e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3566642758087631e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.783321379043816e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.391660689521908e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.695830344760954e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.47915172380477e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.239575861902385e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1197879309511924e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0598939654755962e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.299469827377981e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6497349136889905e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3248674568444952e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.624337284222476e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.312168642111238e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.656084321055619e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.280421605278095e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.140210802639048e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.070105401319524e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.035052700659762e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.17526350329881e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.587631751649405e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2938158758247024e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.469079379123512e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.234539689561756e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.617269844780878e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.08634922390439e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.043174611952195e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0215873059760975e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0107936529880487e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.053968264940244e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.526984132470122e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.263492066235061e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.317460331175305e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1587301655876523e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5793650827938261e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.896825413969131e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9484127069845653e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9742063534922827e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.871031767461413e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.935515883730707e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4677579418653533e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2338789709326767e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.169394854663383e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.084697427331692e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.542348713665846e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.71174356832923e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.855871784164615e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9279358920823073e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.639679460411536e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.819839730205768e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.409919865102884e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.204959932551442e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.02479966275721e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.012399831378605e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5061999156893026e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.530999578446513e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7654997892232564e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8827498946116282e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.413749473058141e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.706874736529071e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3534373682645353e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1767186841322676e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.883593420661338e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.941796710330669e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4708983551653345e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.354491775826673e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6772458879133364e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8386229439566682e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.193114719783341e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5965573598916705e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2982786799458352e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1491393399729176e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.745696699864588e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.872848349932294e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.436424174966147e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.182120874830735e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5910604374153675e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7955302187076838e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.977651093538419e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4888255467692094e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2444127733846047e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1222063866923024e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.611031933461512e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.805515966730756e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.402757983365378e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.01378991682689e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.506894958413445e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7534474792067224e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.767237396033612e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.383618698016806e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.191809349008403e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0959046745042015e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.479523372521008e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.739761686260504e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.369880843130252e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.84940421565126e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.42470210782563e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.712351053912815e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.561755269564074e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.280877634782037e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1404388173910186e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0702194086955093e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.351097043477547e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6755485217387732e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3377742608693866e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.688871304346933e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3444356521734666e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6722178260867333e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.361089130433666e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.180544565216833e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0902722826084166e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0451361413042083e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.225680706521042e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.612840353260521e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3064201766302604e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.532100883151302e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.266050441575651e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6330252207878255e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.165126103939127e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.082563051969564e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.041281525984782e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.020640762992391e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.103203814961955e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5516019074809773e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2758009537404886e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.379004768702443e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1895023843512216e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5947511921756108e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.973755960878054e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.986877980439027e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9934389902195135e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.967194951097568e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.983597475548784e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.491798737774392e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.245899368887196e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.22949684443598e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.11474842221799e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.557374211108995e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.786871055544975e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8934355277724873e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9467177638862437e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.733588819431218e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.866794409715609e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4333972048578046e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2166986024289023e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.083493012144512e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.041746506072256e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.520873253036128e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.60436626518064e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.80218313259032e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.90109156629516e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5054578314758e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7527289157379e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.37636445786895e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.188182228934475e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.940911144672375e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9704555723361872e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4852277861680936e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.426138930840468e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.713069465420234e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.856534732710117e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.282673663550585e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.641336831775293e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3206684158876463e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1603342079438231e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.801671039719116e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.900835519859558e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.450417759929779e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.252088799648895e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6260443998244473e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8130221999122236e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.065110999561118e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.532555499780559e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2662777498902796e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1331388749451398e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.665694374725699e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8328471873628494e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4164235936814247e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.082117968407124e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.541058984203562e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.770529492101781e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.852647460508905e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4263237302544523e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2131618651272261e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1065809325636131e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5329046628180653e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7664523314090327e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3832261657045163e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.916130828522582e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.458065414261291e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7290327071306454e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.645163535653227e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.322581767826614e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.161290883913307e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0806454419566534e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.403227209783267e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7016136048916335e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3508068024458167e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.754034012229084e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.377017006114542e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.688508503057271e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.442542515286355e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2212712576431773e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1106356288215886e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0553178144107943e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.276589072053972e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.638294536026986e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.319147268013493e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.595736340067465e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2978681700337323e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6489340850168661e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.244670425084331e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1223352125421653e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0611676062710827e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0305838031355413e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.152919015677707e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5764595078388533e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2882297539194267e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.441148769597133e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.220574384798567e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6102871923992833e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.051435961996417e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0257179809982083e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0128589904991042e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0064294952495521e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0321474762477604e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5160737381238802e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2580368690619401e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.290184345309701e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1450921726548502e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5725460863274251e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.862730431637126e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.931365215818563e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9656826079092814e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.828413039546407e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.914206519773204e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.457103259886602e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.228551629943301e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.142758149716505e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0713790748582522e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5356895374291261e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.678447687145631e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8392238435728152e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9196119217864076e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.598059608932038e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.799029804466019e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3995149022330095e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1997574511165048e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.998787255582524e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.999393627791262e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.499696813895631e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.498484069478155e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7492420347390774e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8746210173695387e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.373105086847693e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.686552543423847e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3432762717119234e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1716381358559617e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.858190679279809e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9290953396399042e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4645476698199521e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.322738349099761e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6613691745498803e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8306845872749401e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.153422936374701e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5767114681873503e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2883557340936752e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1441778670468376e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.720889335234188e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.860444667617094e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.430222333808547e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.151111669042735e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5755558345213674e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7877779172606837e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.938889586303419e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4694447931517093e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2347223965758547e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1173611982879273e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.586805991439637e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7934029957198183e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3967014978599092e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.983507489299546e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.491753744649773e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7458768723248864e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.729384361624432e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.364692180812216e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.182346090406108e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.091173045203054e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.45586522601527e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.727932613007635e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3639663065038175e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.819831532519088e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.409915766259544e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.704957883129772e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.52478941564886e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.26239470782443e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.131197353912215e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0655986769561075e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.327993384780537e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6639966923902686e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3319983461951343e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.659991730975672e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.329995865487836e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.664997932743918e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.32498966371959e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.162494831859795e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0812474159298974e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0406237079649487e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.2031185398247434e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6015592699123717e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3007796349561859e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.503898174780929e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2519490873904646e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6259745436952323e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.129872718476162e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.064936359238081e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0324681796190404e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0162340898095202e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.081170449047601e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5405852245238005e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2702926122619002e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.351463061309501e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1757315306547506e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5878657653273753e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.939328826636877e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9696644133184383e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9848322066592191e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.924161033296096e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.962080516648048e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.481040258324024e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.240520129162012e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.20260064581006e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.10130032290503e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.550650161452515e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.753250807262575e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8766254036312874e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9383127018156437e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.691563509078218e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.845781754539109e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4228908772695546e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2114454386347773e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.057227193173887e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0286135965869433e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5143067982934716e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.571533991467358e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.785766995733679e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8928834978668395e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.464417489334198e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.732208744667099e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3661043723335494e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1830521861667747e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.915260930833874e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.957630465416937e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4788152327084684e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.394076163542342e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.697038081771171e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8485190408855855e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.242595204427927e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.621297602213964e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.310648801106982e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.155324400553491e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.776622002767455e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8883110013837273e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4441555006918637e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.220777503459318e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.610388751729659e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8051943758648296e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.025971879324148e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.512985939662074e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.256492969831037e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1282464849155185e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.641232424577593e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8206162122887962e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4103081061443981e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.051540530721991e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5257702653609953e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7628851326804976e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.814425663402488e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.407212831701244e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.203606415850622e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.101803207925311e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.509016039626555e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7545080198132776e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3772540099066388e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.886270049533194e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.443135024766597e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7215675123832985e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.607837561916492e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.303918780958246e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.151959390479123e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0759796952395615e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.379898476197808e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.689949238098904e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.344974619049452e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.72487309524726e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.36243654762363e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.681218273811815e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.406091369059075e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2030456845295373e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1015228422647686e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0507614211323843e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.253807105661922e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.626903552830961e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3134517764154804e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.567258882077402e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.283629441038701e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6418147205193505e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.209073602596753e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1045368012983762e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0522684006491881e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0261342003245941e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1306710016229703e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5653355008114852e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2826677504057426e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.413338752028713e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2066693760143564e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6033346880071782e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.016673440035891e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.008336720017946e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.004168360008973e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0020841800044864e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.010420900022432e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.505210450011216e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.252605225005608e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.26302612502804e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.13151306251402e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.56575653125701e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.82878265628505e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.914391328142525e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9571956640712625e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.785978320356312e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.892989160178156e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.446494580089078e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.223247290044539e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.116236450222695e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0581182251113476e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5290591125556738e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.645295562778369e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8226477813891845e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9113238906945923e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.556619453472961e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.778309726736481e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3891548633682403e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1945774316841202e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.972887158420601e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9864435792103004e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4932217896051502e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.466108948025751e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7330544740128755e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8665272370064378e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.332636185032189e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6663180925160944e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3331590462580472e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1665795231290236e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.832897615645118e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.916448807822559e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4582244039112795e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.291122019556398e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.645561009778199e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8227805048890994e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.113902524445497e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5569512622227484e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2784756311113742e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1392378155556871e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.696189077778436e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.848094538889218e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.424047269444609e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.120236347223045e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5601181736115222e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7800590868057611e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.900295434028806e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.450147717014403e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2250738585072014e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1125369292536007e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.562684646268003e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.781342323134e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.390671161567e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.953355807835e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4766779039175e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.73833895195875e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.691694759794e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.345847379897e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1729236899484e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.086461844974e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.43230922487e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.716154612436e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.35807730622e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.7903865311e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.39519326554e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.69759663277e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.487983164e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.243991582e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.121995791e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0609978955e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.304989477e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.65249474e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.32624737e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.63123685e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3156184e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6578092e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.289046e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.144523e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0722615e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.036131e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.180654e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.590327e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.295163e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.4758e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2379e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.61895e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.095e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0474e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0237e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.012e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.06e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.53e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.265e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.3e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.16e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5e-324\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0</p>\n\n<hr>\n\n<p>ZeroDivisionError                         Traceback (most recent call last)</p>",
      "rawMarkdown": "I was trying this model in google colab : https://www.kaggle.com/taindow/pytorch-resnext-101-32x8d-benchmark\n\ni reduced the size of the data so colab doesn't crash and also reduced the batch size down to 32 but after almost 2 hours model training i get this error : \n**ZeroDivisionError: float division by zero**\n\ni understand why this error is happening but can't understand what to do to solve this error? is it because batch size = 32 and not 64?\n\nhere is my model log : \n\n\nEpoch 0/0\n----------\n\nIteration\n5% 1091/20994 [43:46&lt;13:17:55, 2.41s/it]\n\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32768.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16384.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8192.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4096.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2048.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1024.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 512.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 256.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 128.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 64.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.5\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.03125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.015625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0078125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00390625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.001953125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0009765625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00048828125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.000244140625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0001220703125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.103515625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0517578125e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.52587890625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.62939453125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.814697265625e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9073486328125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5367431640625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.76837158203125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.384185791015625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1920928955078125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.960464477539063e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9802322387695312e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4901161193847656e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.450580596923828e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.725290298461914e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.862645149230957e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.313225746154785e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.656612873077393e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3283064365386963e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1641532182693481e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.820766091346741e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9103830456733704e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4551915228366852e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.275957614183426e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.637978807091713e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8189894035458565e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.094947017729282e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.547473508864641e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2737367544323206e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1368683772161603e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.684341886080802e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.842170943040401e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4210854715202004e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.105427357601002e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.552713678800501e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7763568394002505e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.881784197001252e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.440892098500626e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.220446049250313e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1102230246251565e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.551115123125783e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7755575615628914e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3877787807814457e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.938893903907228e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.469446951953614e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.734723475976807e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.673617379884035e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.336808689942018e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.168404344971009e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0842021724855044e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.421010862427522e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.710505431213761e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3552527156068805e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.776263578034403e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3881317890172014e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6940658945086007e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.470329472543003e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.235164736271502e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.117582368135751e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0587911840678754e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.293955920339377e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6469779601696886e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3234889800848443e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.617444900424222e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.308722450212111e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6543612251060553e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.271806125530277e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1359030627651384e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0679515313825692e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0339757656912846e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.169878828456423e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5849394142282115e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2924697071141057e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.462348535570529e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2311742677852644e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6155871338926322e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.077935669463161e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0389678347315804e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0194839173657902e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0097419586828951e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.048709793414476e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.524354896707238e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.262177448353619e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.310887241768095e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1554436208840472e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5777218104420236e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.888609052210118e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.944304526105059e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9721522630525295e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.860761315262648e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.930380657631324e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.465190328815662e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.232595164407831e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.162975822039155e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0814879110195774e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5407439555097887e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.703719777548943e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.851859888774472e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.925929944387236e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.62964972193618e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.81482486096809e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.407412430484045e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2037062152420224e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.018531076210112e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.009265538105056e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.504632769052528e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.52316384526264e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.76158192263132e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.88079096131566e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.4039548065783e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.70197740328915e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.350988701644575e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1754943508222875e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.877471754111438e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.938735877055719e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4693679385278594e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.346839692639297e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6734198463196485e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8367099231598242e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.183549615799121e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.591774807899561e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2958874039497803e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1479437019748901e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.739718509874451e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8698592549372254e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4349296274686127e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.174648137343064e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.587324068671532e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.793662034335766e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.96831017167883e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.484155085839415e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2420775429197073e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1210387714598537e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.605193857299268e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.802596928649634e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.401298464324817e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.006492321624085e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.503246160812043e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7516230804060213e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.758115402030107e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3790577010150533e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1895288505075267e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0947644252537633e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.473822126268817e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7369110631344083e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3684555315672042e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.842277657836021e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4211388289180104e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7105694144590052e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.552847072295026e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.276423536147513e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1382117680737565e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0691058840368783e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.345529420184391e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6727647100921956e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3363823550460978e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.681911775230489e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3409558876152446e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6704779438076223e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.352389719038111e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.176194859519056e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.088097429759528e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.044048714879764e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.22024357439882e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.61012178719941e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.305060893599705e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.525304467998525e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2626522339992623e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6313261169996311e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.156630584998156e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.078315292499078e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.039157646249539e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0195788231247695e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0978941156238473e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5489470578119236e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2744735289059618e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.372367644529809e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1861838222649046e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5930919111324523e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.965459555662261e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.982729777831131e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9913648889155653e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.956824444577827e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9784122222889134e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4892061111444567e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2446030555722283e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.223015277861142e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.111507638930571e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5557538194652854e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.778769097326427e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8893845486632136e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9446922743316068e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.723461371658034e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.861730685829017e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4308653429145085e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2154326714572542e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.077163357286271e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0385816786431356e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5192908393215678e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.596454196607839e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7982270983039195e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8991135491519597e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.495567745759799e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7477838728798994e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3738919364399497e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1869459682199748e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.934729841099874e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.967364920549937e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4836824602749686e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.418412301374843e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7092061506874214e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8546030753437107e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.273015376718553e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.636507688359277e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3182538441796384e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1591269220898192e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.795634610449096e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.897817305224548e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.448908652612274e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.24454326306137e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.622271631530685e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8111358157653425e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.055679078826712e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.527839539413356e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.263919769706678e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.131959884853339e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.659799424266695e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8298997121333476e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4149498560666738e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.074749280333369e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5373746401666845e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7686873200833423e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.843436600416711e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.421718300208356e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.210859150104178e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.105429575052089e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.527147875260445e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7635739376302223e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3817869688151111e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.908934844075556e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.454467422037778e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.727233711018889e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.636168555094445e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3180842775472223e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1590421387736112e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0795210693868056e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.397605346934028e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.698802673467014e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.349401336733507e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.747006683667535e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3735033418337674e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6867516709168837e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.433758354584419e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2168791772922093e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1084395886461046e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0542197943230523e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.271098971615262e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.635549485807631e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3177747429038154e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.588873714519077e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2944368572595385e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6472184286297693e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.236092143148846e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.118046071574423e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0590230357872116e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0295115178936058e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.147557589468029e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5737787947340145e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2868893973670072e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.434446986835036e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.217223493417518e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.608611746708759e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.043058733543795e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.021529366771898e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.010764683385949e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0053823416929744e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.026911708464872e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.513455854232436e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.256727927116218e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.28363963558109e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.141819817790545e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5709099088952725e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.854549544476363e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9272747722381812e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9636373861190906e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.818186930595453e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.909093465297727e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4545467326488633e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2272733663244316e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.136366831622158e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.068183415811079e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5340917079055395e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.670458539527698e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.835229269763849e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9176146348819244e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.588073174409622e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.794036587204811e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3970182936024055e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1985091468012028e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.992545734006014e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.996272867003007e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4981364335015035e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.490682167507517e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.745341083753759e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8726705418768793e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.363352709384397e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6816763546921983e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3408381773460992e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1704190886730496e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.852095443365248e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.926047721682624e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.463023860841312e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.31511930420656e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.65755965210328e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.82877982605164e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.1438991302582e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5719495651291e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.28597478256455e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.142987391282275e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.714936956411375e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8574684782056875e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4287342391028437e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.143671195514219e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5718355977571093e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7859177988785547e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.929588994392773e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.464794497196387e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2323972485981933e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1161986242990967e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5809931214954833e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7904965607477417e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3952482803738708e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.976241401869354e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.488120700934677e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7440603504673385e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.720301752336693e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3601508761683463e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1800754380841732e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0900377190420866e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.450188595210433e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7250942976052165e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3625471488026082e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.812735744013041e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4063678720065206e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7031839360032603e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.515919680016301e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.257959840008151e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1289799200040754e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0644899600020377e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.3224498000101884e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6612249000050942e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3306124500025471e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.653062250012736e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.326531125006368e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.663265562503184e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.31632781251592e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.15816390625796e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.07908195312898e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.03954097656449e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.19770488282245e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.598852441411225e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2994262207056124e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.497131103528062e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.248565551764031e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6242827758820155e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.121413879410078e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.060706939705039e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0303534698525194e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0151767349262597e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.075883674631299e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5379418373156492e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2689709186578246e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.344854593289123e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1724272966445615e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5862136483222808e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.931068241611404e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.965534120805702e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.982767060402851e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.913835302014255e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9569176510071274e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4784588255035637e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2392294127517818e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.196147063758909e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0980735318794546e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5490367659397273e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.745183829698637e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8725919148493183e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9362959574246591e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.681479787123296e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.840739893561648e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.420369946780824e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.210184973390412e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.05092486695206e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.02546243347603e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.512731216738015e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.563656083690075e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7818280418450374e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8909140209225187e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.454570104612593e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.727285052306297e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3636425261531484e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1818212630765742e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.909106315382871e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9545531576914354e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4772765788457177e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.386382894228589e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6931914471142943e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8465957235571472e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.232978617785736e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.616489308892868e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.308244654446434e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.154122327223217e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.770611636116085e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8853058180580424e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4426529090290212e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.213264545145106e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.606632272572553e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8033161362862765e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.016580681431383e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5082903407156913e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2541451703578456e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1270725851789228e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.635362925894614e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.817681462947307e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4088407314736535e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.044203657368268e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.522101828684134e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.761050914342067e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.805254571710335e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4026272858551673e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2013136429275836e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1006568214637918e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.503284107318959e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7516420536594796e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3758210268297398e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.879105134148699e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4395525670743494e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7197762835371747e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.598881417685874e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.299440708842937e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1497203544214684e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0748601772107342e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.374300886053671e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6871504430268355e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3435752215134178e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.717876107567089e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3589380537835444e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6794690268917722e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.397345134458861e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1986725672294305e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0993362836147152e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0496681418073576e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.248340709036788e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.624170354518394e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.312085177259197e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.560425886295985e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2802129431479926e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6401064715739963e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.200532357869981e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.100266178934991e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0501330894674953e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0250665447337477e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1253327236687384e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5626663618343692e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2813331809171846e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.406665904585923e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2033329522929615e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6016664761464807e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.008332380732404e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.004166190366202e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.002083095183101e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0010415475915505e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0052077379577523e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5026038689788762e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2513019344894381e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.256509672447191e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1282548362235952e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5641274181117976e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.820637090558988e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.910318545279494e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.955159272639747e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.775796363198735e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.887898181599368e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.443949090799684e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.221974545399842e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.10987272699921e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.054936363499605e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5274681817498023e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.637340908749012e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.818670454374506e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.909335227187253e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.546676135936265e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7733380679681323e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3866690339840662e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1933345169920331e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.966672584960166e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.983336292480083e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4916681462400413e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.458340731200207e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7291703656001034e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8645851828000517e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.322925914000258e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.661462957000129e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3307314785000646e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1653657392500323e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.826828696250162e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.913414348125081e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4567071740625404e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.283535870312702e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.641767935156351e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8208839675781755e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.104419837890877e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.552209918945439e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2761049594727193e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1380524797363597e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.6902623986817984e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8451311993408992e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4225655996704496e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.112827998352248e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.556413999176124e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.778206999588062e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.89103499794031e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.445517498970155e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2227587494850775e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1113793747425387e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.556896873712694e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.778448436856347e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3892242184281734e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.946121092140867e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4730605460704336e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7365302730352168e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.682651365176084e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.341325682588042e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.170662841294021e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0853314206470105e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.426657103235053e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7133285516175262e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3566642758087631e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.783321379043816e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.391660689521908e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.695830344760954e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.47915172380477e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.239575861902385e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1197879309511924e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0598939654755962e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.299469827377981e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6497349136889905e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3248674568444952e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.624337284222476e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.312168642111238e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.656084321055619e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.280421605278095e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.140210802639048e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.070105401319524e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.035052700659762e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.17526350329881e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.587631751649405e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2938158758247024e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.469079379123512e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.234539689561756e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.617269844780878e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.08634922390439e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.043174611952195e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0215873059760975e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0107936529880487e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.053968264940244e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.526984132470122e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.263492066235061e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.317460331175305e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1587301655876523e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5793650827938261e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.896825413969131e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9484127069845653e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9742063534922827e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.871031767461413e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.935515883730707e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4677579418653533e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2338789709326767e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.169394854663383e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.084697427331692e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.542348713665846e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.71174356832923e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.855871784164615e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9279358920823073e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.639679460411536e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.819839730205768e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.409919865102884e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.204959932551442e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.02479966275721e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.012399831378605e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5061999156893026e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.530999578446513e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7654997892232564e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8827498946116282e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.413749473058141e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.706874736529071e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3534373682645353e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1767186841322676e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.883593420661338e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.941796710330669e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4708983551653345e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.354491775826673e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6772458879133364e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8386229439566682e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.193114719783341e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5965573598916705e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2982786799458352e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1491393399729176e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.745696699864588e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.872848349932294e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.436424174966147e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.182120874830735e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5910604374153675e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7955302187076838e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.977651093538419e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4888255467692094e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2444127733846047e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1222063866923024e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.611031933461512e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.805515966730756e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.402757983365378e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.01378991682689e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.506894958413445e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7534474792067224e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.767237396033612e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.383618698016806e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.191809349008403e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0959046745042015e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.479523372521008e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.739761686260504e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.369880843130252e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.84940421565126e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.42470210782563e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.712351053912815e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.561755269564074e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.280877634782037e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1404388173910186e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0702194086955093e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.351097043477547e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6755485217387732e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3377742608693866e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.688871304346933e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3444356521734666e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6722178260867333e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.361089130433666e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.180544565216833e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0902722826084166e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0451361413042083e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.225680706521042e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.612840353260521e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3064201766302604e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.532100883151302e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.266050441575651e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6330252207878255e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.165126103939127e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.082563051969564e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.041281525984782e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.020640762992391e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.103203814961955e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5516019074809773e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2758009537404886e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.379004768702443e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1895023843512216e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5947511921756108e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.973755960878054e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.986877980439027e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9934389902195135e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.967194951097568e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.983597475548784e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.491798737774392e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.245899368887196e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.22949684443598e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.11474842221799e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.557374211108995e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.786871055544975e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8934355277724873e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9467177638862437e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.733588819431218e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.866794409715609e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4333972048578046e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2166986024289023e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.083493012144512e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.041746506072256e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.520873253036128e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.60436626518064e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.80218313259032e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.90109156629516e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5054578314758e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7527289157379e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.37636445786895e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.188182228934475e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.940911144672375e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9704555723361872e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4852277861680936e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.426138930840468e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.713069465420234e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.856534732710117e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.282673663550585e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.641336831775293e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3206684158876463e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1603342079438231e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.801671039719116e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.900835519859558e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.450417759929779e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.252088799648895e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6260443998244473e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8130221999122236e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.065110999561118e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.532555499780559e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2662777498902796e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1331388749451398e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.665694374725699e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8328471873628494e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4164235936814247e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.082117968407124e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.541058984203562e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.770529492101781e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.852647460508905e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4263237302544523e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2131618651272261e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1065809325636131e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5329046628180653e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7664523314090327e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3832261657045163e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.916130828522582e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.458065414261291e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7290327071306454e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.645163535653227e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.322581767826614e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.161290883913307e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0806454419566534e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.403227209783267e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7016136048916335e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3508068024458167e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.754034012229084e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.377017006114542e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.688508503057271e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.442542515286355e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2212712576431773e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1106356288215886e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0553178144107943e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.276589072053972e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.638294536026986e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.319147268013493e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.595736340067465e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2978681700337323e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6489340850168661e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.244670425084331e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1223352125421653e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0611676062710827e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0305838031355413e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.152919015677707e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5764595078388533e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2882297539194267e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.441148769597133e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.220574384798567e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6102871923992833e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.051435961996417e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0257179809982083e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0128589904991042e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0064294952495521e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0321474762477604e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5160737381238802e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2580368690619401e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.290184345309701e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1450921726548502e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5725460863274251e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.862730431637126e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.931365215818563e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9656826079092814e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.828413039546407e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.914206519773204e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.457103259886602e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.228551629943301e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.142758149716505e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0713790748582522e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5356895374291261e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.678447687145631e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8392238435728152e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9196119217864076e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.598059608932038e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.799029804466019e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3995149022330095e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1997574511165048e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.998787255582524e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.999393627791262e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.499696813895631e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.498484069478155e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7492420347390774e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8746210173695387e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.373105086847693e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.686552543423847e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3432762717119234e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1716381358559617e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.858190679279809e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9290953396399042e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4645476698199521e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.322738349099761e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6613691745498803e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8306845872749401e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.153422936374701e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5767114681873503e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2883557340936752e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1441778670468376e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.720889335234188e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.860444667617094e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.430222333808547e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.151111669042735e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5755558345213674e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7877779172606837e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.938889586303419e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4694447931517093e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2347223965758547e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1173611982879273e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.586805991439637e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7934029957198183e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3967014978599092e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.983507489299546e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.491753744649773e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7458768723248864e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.729384361624432e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.364692180812216e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.182346090406108e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.091173045203054e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.45586522601527e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.727932613007635e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3639663065038175e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.819831532519088e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.409915766259544e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.704957883129772e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.52478941564886e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.26239470782443e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.131197353912215e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0655986769561075e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.327993384780537e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6639966923902686e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3319983461951343e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.659991730975672e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.329995865487836e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.664997932743918e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.32498966371959e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.162494831859795e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0812474159298974e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0406237079649487e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.2031185398247434e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6015592699123717e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3007796349561859e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.503898174780929e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2519490873904646e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6259745436952323e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.129872718476162e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.064936359238081e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0324681796190404e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0162340898095202e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.081170449047601e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5405852245238005e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2702926122619002e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.351463061309501e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1757315306547506e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5878657653273753e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.939328826636877e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9696644133184383e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9848322066592191e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.924161033296096e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.962080516648048e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.481040258324024e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.240520129162012e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.20260064581006e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.10130032290503e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.550650161452515e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.753250807262575e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8766254036312874e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9383127018156437e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.691563509078218e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.845781754539109e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4228908772695546e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2114454386347773e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.057227193173887e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0286135965869433e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5143067982934716e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.571533991467358e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.785766995733679e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8928834978668395e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.464417489334198e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.732208744667099e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3661043723335494e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1830521861667747e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.915260930833874e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.957630465416937e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4788152327084684e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.394076163542342e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.697038081771171e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8485190408855855e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.242595204427927e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.621297602213964e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.310648801106982e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.155324400553491e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.776622002767455e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8883110013837273e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4441555006918637e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.220777503459318e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.610388751729659e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8051943758648296e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.025971879324148e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.512985939662074e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.256492969831037e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1282464849155185e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.641232424577593e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8206162122887962e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4103081061443981e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.051540530721991e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5257702653609953e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7628851326804976e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.814425663402488e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.407212831701244e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.203606415850622e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.101803207925311e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.509016039626555e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7545080198132776e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3772540099066388e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.886270049533194e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.443135024766597e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7215675123832985e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.607837561916492e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.303918780958246e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.151959390479123e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0759796952395615e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.379898476197808e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.689949238098904e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.344974619049452e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.72487309524726e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.36243654762363e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.681218273811815e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.406091369059075e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2030456845295373e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1015228422647686e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0507614211323843e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.253807105661922e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.626903552830961e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3134517764154804e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.567258882077402e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.283629441038701e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6418147205193505e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.209073602596753e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1045368012983762e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0522684006491881e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0261342003245941e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1306710016229703e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5653355008114852e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2826677504057426e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.413338752028713e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2066693760143564e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6033346880071782e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.016673440035891e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.008336720017946e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.004168360008973e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0020841800044864e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.010420900022432e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.505210450011216e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.252605225005608e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.26302612502804e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.13151306251402e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.56575653125701e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.82878265628505e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.914391328142525e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9571956640712625e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.785978320356312e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.892989160178156e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.446494580089078e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.223247290044539e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.116236450222695e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0581182251113476e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5290591125556738e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.645295562778369e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8226477813891845e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9113238906945923e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.556619453472961e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.778309726736481e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3891548633682403e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1945774316841202e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.972887158420601e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9864435792103004e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4932217896051502e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.466108948025751e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7330544740128755e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8665272370064378e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.332636185032189e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6663180925160944e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3331590462580472e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1665795231290236e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.832897615645118e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.916448807822559e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4582244039112795e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.291122019556398e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.645561009778199e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8227805048890994e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.113902524445497e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5569512622227484e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2784756311113742e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1392378155556871e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.696189077778436e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.848094538889218e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.424047269444609e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.120236347223045e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5601181736115222e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7800590868057611e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.900295434028806e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.450147717014403e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2250738585072014e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1125369292536007e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.562684646268003e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.781342323134e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.390671161567e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.953355807835e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4766779039175e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.73833895195875e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.691694759794e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.345847379897e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1729236899484e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.086461844974e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.43230922487e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.716154612436e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.35807730622e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.7903865311e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.39519326554e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.69759663277e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.487983164e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.243991582e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.121995791e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0609978955e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.304989477e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.65249474e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.32624737e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.63123685e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3156184e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6578092e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.289046e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.144523e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0722615e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.036131e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.180654e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.590327e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.295163e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.4758e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2379e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.61895e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.095e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0474e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0237e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.012e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.06e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.53e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.265e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.3e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.16e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5e-324\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0\n\n---------------------------------------------------------------------------\n\nZeroDivisionError                         Traceback (most recent call last)\n\n",
      "votes": 7
    },
    {
      "id": 646541,
      "postDate": "2019-10-11T12:04:12.560Z",
      "content": "<p>That means the last batch has only one input sample and batchnorm doesn't work for batch size 1 (for obvious reasons), add a check to prevent this and you'll be good. \nA tip: don't post such long error logs directly, use pastebin.</p>",
      "rawMarkdown": "That means the last batch has only one input sample and batchnorm doesn't work for batch size 1 (for obvious reasons), add a check to prevent this and you'll be good. \nA tip: don't post such long error logs directly, use pastebin.",
      "votes": 5,
      "replies": [
        {
          "id": 646733,
          "postDate": "2019-10-11T16:35:13.350Z",
          "content": "<p>thanks for your comment,i thought  a lot of kagglers won't click the pastebin link to see the log so i didn't use pastebin,will use next time but i would like to know why my model producing 1 batch size for batchnorm over and over again even for batch size = 32 and for batch size  = 64 but that kaggle kernel is not having this error,maybe the problem is for something else too</p>",
          "rawMarkdown": "thanks for your comment,i thought  a lot of kagglers won't click the pastebin link to see the log so i didn't use pastebin,will use next time but i would like to know why my model producing 1 batch size for batchnorm over and over again even for batch size = 32 and for batch size  = 64 but that kaggle kernel is not having this error,maybe the problem is for something else too"
        },
        {
          "id": 646757,
          "postDate": "2019-10-11T17:09:00.613Z",
          "content": "<p>suppose we got total samples: 97 and batch size: 32\nfirst, second and third batch contain 32 samples each totaling upto 96 samples, now fourth batch=1 sample only and here the BN layers will throw zero division error.</p>",
          "rawMarkdown": "suppose we got total samples: 97 and batch size: 32\nfirst, second and third batch contain 32 samples each totaling upto 96 samples, now fourth batch=1 sample only and here the BN layers will throw zero division error.\n\n",
          "votes": 1
        },
        {
          "id": 646768,
          "postDate": "2019-10-11T17:26:23.140Z",
          "content": "<p>ok,i will choose a batch size this time that is divisible by 64 and will see if i get same error or not,thank you a lot mate for your comment,you are a very good person,god bless you &lt;3 </p>",
          "rawMarkdown": "ok,i will choose a batch size this time that is divisible by 64 and will see if i get same error or not,thank you a lot mate for your comment,you are a very good person,god bless you &lt;3 "
        },
        {
          "id": 646781,
          "postDate": "2019-10-11T17:39:22.717Z",
          "content": "<p>Just use total sample size which is highest possible multiple of your batch size.</p>\n\n<p>A tip: use a space after comma.</p>",
          "rawMarkdown": "Just use total sample size which is highest possible multiple of your batch size.\n\nA tip: use a space after comma.",
          "votes": 2
        },
        {
          "id": 646810,
          "postDate": "2019-10-11T18:22:37.067Z",
          "content": "<p>sample size = 3045568\nbatch size = 64</p>\n\n<p>3045568 / 64 = 47,587</p>\n\n<p>i shouldn't get ZeroDivisionError now</p>\n\n<p><a href=\"/rishabhiitbhu\">@rishabhiitbhu</a> </p>",
          "rawMarkdown": "sample size = 3045568\nbatch size = 64\n\n3045568 / 64 = 47,587\n\ni shouldn't get ZeroDivisionError now\n\n@rishabhiitbhu ",
          "votes": 1
        },
        {
          "id": 647515,
          "postDate": "2019-10-12T18:39:36.820Z",
          "content": "<p>Use <code>drop_last=True</code> in your <code>Dataloader</code> to prevent the batch norm errors.</p>\n\n<p>Fundamentally the gradient is exploding (hence why the loss scaler has to be a tiny number). If you are still facing issues try running without mixed-precision and then figure out why the gradient might be exploding (e.g. issues in how the images were prepared, unstable loss function etc.)</p>",
          "rawMarkdown": "Use `drop_last=True` in your `Dataloader` to prevent the batch norm errors.\n\nFundamentally the gradient is exploding (hence why the loss scaler has to be a tiny number). If you are still facing issues try running without mixed-precision and then figure out why the gradient might be exploding (e.g. issues in how the images were prepared, unstable loss function etc.)",
          "votes": 6
        }
      ]
    },
    {
      "id": 647799,
      "postDate": "2019-10-13T09:45:46.283Z",
      "content": "<p>Apex and multi gpu sometimes got nan output. <br>\nI tried <a href=\"https://discuss.pytorch.org/t/adam-half-precision-nans/1765\">this post</a>. But it didn't solve. <br>\nNow, I don't use apex qq</p>",
      "rawMarkdown": "Apex and multi gpu sometimes got nan output.  \nI tried [this post](https://discuss.pytorch.org/t/adam-half-precision-nans/1765). But it didn't solve.  \nNow, I don't use apex qq",
      "votes": 1,
      "replies": [
        {
          "id": 647824,
          "postDate": "2019-10-13T10:52:26.157Z",
          "content": "<p>thanks for your comment <a href=\"/takuok\">@takuok</a> \nnow i can fully understand my models problem</p>",
          "rawMarkdown": "thanks for your comment @takuok \nnow i can fully understand my models problem",
          "votes": 1
        }
      ]
    },
    {
      "id": 647634,
      "postDate": "2019-10-13T02:33:22.757Z",
      "content": "<p><a href=\"/mobassir\">@mobassir</a> Double check you do not have nans in input ... this can cause this issue</p>",
      "rawMarkdown": "@mobassir Double check you do not have nans in input ... this can cause this issue",
      "votes": 1,
      "replies": [
        {
          "id": 647829,
          "postDate": "2019-10-13T11:03:23.863Z",
          "content": "<p>thank you <a href=\"/taindow\">@taindow</a> </p>\n\n<p>actually i reduced 1000004 samples from the dataframe just like this : \nremove_n = 1000004 \ndrop_indices = np.random.choice(df.index, remove_n, replace=False)\ndf = df.drop(drop_indices)</p>\n\n<p>everything alse was exactly same as your notebook,i just dropped 1000004  samples before training so the algorithm can be trained for 1 epoch in colab without crashing the notebook but it didn't help,after 2 hours of training i always see my notebook crashed and browser crashed and then all i get to do is to shut down the computer,i loved your kernel a lot and spend so much time on that in colab but it all goes in vein :(\nAnyway,thanks for your beautiful kernel</p>",
          "rawMarkdown": "thank you @taindow \n\nactually i reduced 1000004 samples from the dataframe just like this : \nremove_n = 1000004 \ndrop_indices = np.random.choice(df.index, remove_n, replace=False)\ndf = df.drop(drop_indices)\n\neverything alse was exactly same as your notebook,i just dropped 1000004  samples before training so the algorithm can be trained for 1 epoch in colab without crashing the notebook but it didn't help,after 2 hours of training i always see my notebook crashed and browser crashed and then all i get to do is to shut down the computer,i loved your kernel a lot and spend so much time on that in colab but it all goes in vein :(\nAnyway,thanks for your beautiful kernel",
          "votes": 1
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 646541,
      "author_name": "Rishabh Agrahari",
      "author_url": "",
      "post_date": "2019-10-11T12:04:12.560000",
      "content": "<p>That means the last batch has only one input sample and batchnorm doesn't work for batch size 1 (for obvious reasons), add a check to prevent this and you'll be good. \nA tip: don't post such long error logs directly, use pastebin.</p>",
      "votes": 5,
      "replies": [
        {
          "id": 646733,
          "author_name": "Mobassir",
          "author_url": "",
          "post_date": "2019-10-11T16:35:13.350000",
          "content": "<p>thanks for your comment,i thought  a lot of kagglers won't click the pastebin link to see the log so i didn't use pastebin,will use next time but i would like to know why my model producing 1 batch size for batchnorm over and over again even for batch size = 32 and for batch size  = 64 but that kaggle kernel is not having this error,maybe the problem is for something else too</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 646757,
          "author_name": "Rishabh Agrahari",
          "author_url": "",
          "post_date": "2019-10-11T17:09:00.613000",
          "content": "<p>suppose we got total samples: 97 and batch size: 32\nfirst, second and third batch contain 32 samples each totaling upto 96 samples, now fourth batch=1 sample only and here the BN layers will throw zero division error.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 646768,
          "author_name": "Mobassir",
          "author_url": "",
          "post_date": "2019-10-11T17:26:23.140000",
          "content": "<p>ok,i will choose a batch size this time that is divisible by 64 and will see if i get same error or not,thank you a lot mate for your comment,you are a very good person,god bless you &lt;3 </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 646781,
          "author_name": "Rishabh Agrahari",
          "author_url": "",
          "post_date": "2019-10-11T17:39:22.717000",
          "content": "<p>Just use total sample size which is highest possible multiple of your batch size.</p>\n\n<p>A tip: use a space after comma.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 646810,
          "author_name": "Mobassir",
          "author_url": "",
          "post_date": "2019-10-11T18:22:37.067000",
          "content": "<p>sample size = 3045568\nbatch size = 64</p>\n\n<p>3045568 / 64 = 47,587</p>\n\n<p>i shouldn't get ZeroDivisionError now</p>\n\n<p><a href=\"/rishabhiitbhu\">@rishabhiitbhu</a> </p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 647515,
          "author_name": "datasaurus",
          "author_url": "",
          "post_date": "2019-10-12T18:39:36.820000",
          "content": "<p>Use <code>drop_last=True</code> in your <code>Dataloader</code> to prevent the batch norm errors.</p>\n\n<p>Fundamentally the gradient is exploding (hence why the loss scaler has to be a tiny number). If you are still facing issues try running without mixed-precision and then figure out why the gradient might be exploding (e.g. issues in how the images were prepared, unstable loss function etc.)</p>",
          "votes": 6,
          "replies": []
        }
      ]
    },
    {
      "id": 647799,
      "author_name": "takuoko",
      "author_url": "",
      "post_date": "2019-10-13T09:45:46.283000",
      "content": "<p>Apex and multi gpu sometimes got nan output. <br>\nI tried <a href=\"https://discuss.pytorch.org/t/adam-half-precision-nans/1765\">this post</a>. But it didn't solve. <br>\nNow, I don't use apex qq</p>",
      "votes": 1,
      "replies": [
        {
          "id": 647824,
          "author_name": "Mobassir",
          "author_url": "",
          "post_date": "2019-10-13T10:52:26.157000",
          "content": "<p>thanks for your comment <a href=\"/takuok\">@takuok</a> \nnow i can fully understand my models problem</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 647634,
      "author_name": "Tom Aindow",
      "author_url": "",
      "post_date": "2019-10-13T02:33:22.757000",
      "content": "<p><a href=\"/mobassir\">@mobassir</a> Double check you do not have nans in input ... this can cause this issue</p>",
      "votes": 1,
      "replies": [
        {
          "id": 647829,
          "author_name": "Mobassir",
          "author_url": "",
          "post_date": "2019-10-13T11:03:23.863000",
          "content": "<p>thank you <a href=\"/taindow\">@taindow</a> </p>\n\n<p>actually i reduced 1000004 samples from the dataframe just like this : \nremove_n = 1000004 \ndrop_indices = np.random.choice(df.index, remove_n, replace=False)\ndf = df.drop(drop_indices)</p>\n\n<p>everything alse was exactly same as your notebook,i just dropped 1000004  samples before training so the algorithm can be trained for 1 epoch in colab without crashing the notebook but it didn't help,after 2 hours of training i always see my notebook crashed and browser crashed and then all i get to do is to shut down the computer,i loved your kernel a lot and spend so much time on that in colab but it all goes in vein :(\nAnyway,thanks for your beautiful kernel</p>",
          "votes": 1,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "646493": "I was trying this model in google colab : https://www.kaggle.com/taindow/pytorch-resnext-101-32x8d-benchmark\n\ni reduced the size of the data so colab doesn't crash and also reduced the batch size down to 32 but after almost 2 hours model training i get this error : \n**ZeroDivisionError: float division by zero**\n\ni understand why this error is happening but can't understand what to do to solve this error? is it because batch size = 32 and not 64?\n\nhere is my model log : \n\n\nEpoch 0/0\n----------\n\nIteration\n5% 1091/20994 [43:46&lt;13:17:55, 2.41s/it]\n\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32768.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16384.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8192.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4096.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2048.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1024.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 512.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 256.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 128.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 64.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 32.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.5\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.03125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.015625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0078125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00390625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.001953125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0009765625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.00048828125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.000244140625\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0001220703125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.103515625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0517578125e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.52587890625e-05\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.62939453125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.814697265625e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9073486328125e-06\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5367431640625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.76837158203125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.384185791015625e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1920928955078125e-07\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.960464477539063e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9802322387695312e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4901161193847656e-08\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.450580596923828e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.725290298461914e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.862645149230957e-09\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.313225746154785e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.656612873077393e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3283064365386963e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1641532182693481e-10\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.820766091346741e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9103830456733704e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4551915228366852e-11\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.275957614183426e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.637978807091713e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8189894035458565e-12\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.094947017729282e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.547473508864641e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2737367544323206e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1368683772161603e-13\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.684341886080802e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.842170943040401e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4210854715202004e-14\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.105427357601002e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.552713678800501e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7763568394002505e-15\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.881784197001252e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.440892098500626e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.220446049250313e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1102230246251565e-16\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.551115123125783e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7755575615628914e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3877787807814457e-17\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.938893903907228e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.469446951953614e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.734723475976807e-18\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.673617379884035e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.336808689942018e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.168404344971009e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0842021724855044e-19\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.421010862427522e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.710505431213761e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3552527156068805e-20\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.776263578034403e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3881317890172014e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6940658945086007e-21\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.470329472543003e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.235164736271502e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.117582368135751e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0587911840678754e-22\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.293955920339377e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6469779601696886e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3234889800848443e-23\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.617444900424222e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.308722450212111e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6543612251060553e-24\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.271806125530277e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1359030627651384e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0679515313825692e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0339757656912846e-25\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.169878828456423e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5849394142282115e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2924697071141057e-26\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.462348535570529e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2311742677852644e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6155871338926322e-27\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.077935669463161e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0389678347315804e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0194839173657902e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0097419586828951e-28\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.048709793414476e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.524354896707238e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.262177448353619e-29\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.310887241768095e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1554436208840472e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5777218104420236e-30\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.888609052210118e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.944304526105059e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9721522630525295e-31\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.860761315262648e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.930380657631324e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.465190328815662e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.232595164407831e-32\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.162975822039155e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0814879110195774e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5407439555097887e-33\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.703719777548943e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.851859888774472e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.925929944387236e-34\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.62964972193618e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.81482486096809e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.407412430484045e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2037062152420224e-35\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.018531076210112e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.009265538105056e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.504632769052528e-36\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.52316384526264e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.76158192263132e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.88079096131566e-37\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.4039548065783e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.70197740328915e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.350988701644575e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1754943508222875e-38\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.877471754111438e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.938735877055719e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4693679385278594e-39\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.346839692639297e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6734198463196485e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8367099231598242e-40\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.183549615799121e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.591774807899561e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2958874039497803e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1479437019748901e-41\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.739718509874451e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8698592549372254e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4349296274686127e-42\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.174648137343064e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.587324068671532e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.793662034335766e-43\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.96831017167883e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.484155085839415e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2420775429197073e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1210387714598537e-44\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.605193857299268e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.802596928649634e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.401298464324817e-45\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.006492321624085e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.503246160812043e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7516230804060213e-46\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.758115402030107e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3790577010150533e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1895288505075267e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0947644252537633e-47\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.473822126268817e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7369110631344083e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3684555315672042e-48\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.842277657836021e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4211388289180104e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7105694144590052e-49\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.552847072295026e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.276423536147513e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1382117680737565e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0691058840368783e-50\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.345529420184391e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6727647100921956e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3363823550460978e-51\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.681911775230489e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3409558876152446e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6704779438076223e-52\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.352389719038111e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.176194859519056e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.088097429759528e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.044048714879764e-53\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.22024357439882e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.61012178719941e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.305060893599705e-54\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.525304467998525e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2626522339992623e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6313261169996311e-55\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.156630584998156e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.078315292499078e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.039157646249539e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0195788231247695e-56\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0978941156238473e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5489470578119236e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2744735289059618e-57\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.372367644529809e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1861838222649046e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5930919111324523e-58\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.965459555662261e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.982729777831131e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9913648889155653e-59\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.956824444577827e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9784122222889134e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4892061111444567e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2446030555722283e-60\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.223015277861142e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.111507638930571e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5557538194652854e-61\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.778769097326427e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8893845486632136e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9446922743316068e-62\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.723461371658034e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.861730685829017e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4308653429145085e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2154326714572542e-63\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.077163357286271e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0385816786431356e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5192908393215678e-64\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.596454196607839e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7982270983039195e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8991135491519597e-65\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.495567745759799e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7477838728798994e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3738919364399497e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1869459682199748e-66\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.934729841099874e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.967364920549937e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4836824602749686e-67\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.418412301374843e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7092061506874214e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8546030753437107e-68\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.273015376718553e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.636507688359277e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3182538441796384e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1591269220898192e-69\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.795634610449096e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.897817305224548e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.448908652612274e-70\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.24454326306137e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.622271631530685e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8111358157653425e-71\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.055679078826712e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.527839539413356e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.263919769706678e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.131959884853339e-72\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.659799424266695e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8298997121333476e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4149498560666738e-73\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.074749280333369e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5373746401666845e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7686873200833423e-74\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.843436600416711e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.421718300208356e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.210859150104178e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.105429575052089e-75\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.527147875260445e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7635739376302223e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3817869688151111e-76\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.908934844075556e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.454467422037778e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.727233711018889e-77\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.636168555094445e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3180842775472223e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1590421387736112e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0795210693868056e-78\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.397605346934028e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.698802673467014e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.349401336733507e-79\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.747006683667535e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3735033418337674e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6867516709168837e-80\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.433758354584419e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2168791772922093e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1084395886461046e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0542197943230523e-81\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.271098971615262e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.635549485807631e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3177747429038154e-82\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.588873714519077e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2944368572595385e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6472184286297693e-83\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.236092143148846e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.118046071574423e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0590230357872116e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0295115178936058e-84\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.147557589468029e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5737787947340145e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2868893973670072e-85\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.434446986835036e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.217223493417518e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.608611746708759e-86\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.043058733543795e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.021529366771898e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.010764683385949e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0053823416929744e-87\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.026911708464872e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.513455854232436e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.256727927116218e-88\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.28363963558109e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.141819817790545e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5709099088952725e-89\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.854549544476363e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9272747722381812e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9636373861190906e-90\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.818186930595453e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.909093465297727e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4545467326488633e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2272733663244316e-91\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.136366831622158e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.068183415811079e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5340917079055395e-92\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.670458539527698e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.835229269763849e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9176146348819244e-93\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.588073174409622e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.794036587204811e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3970182936024055e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1985091468012028e-94\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.992545734006014e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.996272867003007e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4981364335015035e-95\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.490682167507517e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.745341083753759e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8726705418768793e-96\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.363352709384397e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6816763546921983e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3408381773460992e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1704190886730496e-97\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.852095443365248e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.926047721682624e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.463023860841312e-98\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.31511930420656e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.65755965210328e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.82877982605164e-99\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.1438991302582e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5719495651291e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.28597478256455e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.142987391282275e-100\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.714936956411375e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8574684782056875e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4287342391028437e-101\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.143671195514219e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5718355977571093e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7859177988785547e-102\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.929588994392773e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.464794497196387e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2323972485981933e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1161986242990967e-103\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5809931214954833e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7904965607477417e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3952482803738708e-104\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.976241401869354e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.488120700934677e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7440603504673385e-105\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.720301752336693e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.3601508761683463e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1800754380841732e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0900377190420866e-106\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.450188595210433e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7250942976052165e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3625471488026082e-107\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.812735744013041e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4063678720065206e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7031839360032603e-108\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.515919680016301e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.257959840008151e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1289799200040754e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0644899600020377e-109\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.3224498000101884e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6612249000050942e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3306124500025471e-110\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.653062250012736e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.326531125006368e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.663265562503184e-111\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.31632781251592e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.15816390625796e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.07908195312898e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.03954097656449e-112\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.19770488282245e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.598852441411225e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2994262207056124e-113\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.497131103528062e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.248565551764031e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6242827758820155e-114\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.121413879410078e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.060706939705039e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0303534698525194e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0151767349262597e-115\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.075883674631299e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5379418373156492e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2689709186578246e-116\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.344854593289123e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1724272966445615e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5862136483222808e-117\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.931068241611404e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.965534120805702e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.982767060402851e-118\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.913835302014255e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.9569176510071274e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4784588255035637e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2392294127517818e-119\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.196147063758909e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0980735318794546e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5490367659397273e-120\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.745183829698637e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8725919148493183e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9362959574246591e-121\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.681479787123296e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.840739893561648e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.420369946780824e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.210184973390412e-122\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.05092486695206e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.02546243347603e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.512731216738015e-123\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.563656083690075e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7818280418450374e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8909140209225187e-124\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.454570104612593e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.727285052306297e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3636425261531484e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1818212630765742e-125\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.909106315382871e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9545531576914354e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4772765788457177e-126\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.386382894228589e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6931914471142943e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8465957235571472e-127\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.232978617785736e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.616489308892868e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.308244654446434e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.154122327223217e-128\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.770611636116085e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8853058180580424e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4426529090290212e-129\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.213264545145106e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.606632272572553e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8033161362862765e-130\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.016580681431383e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5082903407156913e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2541451703578456e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1270725851789228e-131\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.635362925894614e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.817681462947307e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4088407314736535e-132\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.044203657368268e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.522101828684134e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.761050914342067e-133\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.805254571710335e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4026272858551673e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2013136429275836e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1006568214637918e-134\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.503284107318959e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7516420536594796e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3758210268297398e-135\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.879105134148699e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4395525670743494e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7197762835371747e-136\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.598881417685874e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.299440708842937e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1497203544214684e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0748601772107342e-137\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.374300886053671e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6871504430268355e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3435752215134178e-138\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.717876107567089e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3589380537835444e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6794690268917722e-139\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.397345134458861e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1986725672294305e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0993362836147152e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0496681418073576e-140\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.248340709036788e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.624170354518394e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.312085177259197e-141\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.560425886295985e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2802129431479926e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6401064715739963e-142\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.200532357869981e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.100266178934991e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0501330894674953e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0250665447337477e-143\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1253327236687384e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5626663618343692e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2813331809171846e-144\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.406665904585923e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2033329522929615e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6016664761464807e-145\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.008332380732404e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.004166190366202e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.002083095183101e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0010415475915505e-146\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0052077379577523e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5026038689788762e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2513019344894381e-147\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.256509672447191e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1282548362235952e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5641274181117976e-148\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.820637090558988e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.910318545279494e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.955159272639747e-149\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.775796363198735e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.887898181599368e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.443949090799684e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.221974545399842e-150\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.10987272699921e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.054936363499605e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5274681817498023e-151\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.637340908749012e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.818670454374506e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.909335227187253e-152\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.546676135936265e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7733380679681323e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3866690339840662e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1933345169920331e-153\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.966672584960166e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.983336292480083e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4916681462400413e-154\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.458340731200207e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7291703656001034e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8645851828000517e-155\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.322925914000258e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.661462957000129e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3307314785000646e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1653657392500323e-156\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.826828696250162e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.913414348125081e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4567071740625404e-157\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.283535870312702e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.641767935156351e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8208839675781755e-158\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.104419837890877e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.552209918945439e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2761049594727193e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1380524797363597e-159\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.6902623986817984e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8451311993408992e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4225655996704496e-160\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.112827998352248e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.556413999176124e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.778206999588062e-161\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.89103499794031e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.445517498970155e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2227587494850775e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1113793747425387e-162\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.556896873712694e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.778448436856347e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3892242184281734e-163\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.946121092140867e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4730605460704336e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7365302730352168e-164\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.682651365176084e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.341325682588042e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.170662841294021e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0853314206470105e-165\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.426657103235053e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7133285516175262e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3566642758087631e-166\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.783321379043816e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.391660689521908e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.695830344760954e-167\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.47915172380477e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.239575861902385e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1197879309511924e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0598939654755962e-168\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.299469827377981e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6497349136889905e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3248674568444952e-169\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.624337284222476e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.312168642111238e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.656084321055619e-170\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.280421605278095e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.140210802639048e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.070105401319524e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.035052700659762e-171\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.17526350329881e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.587631751649405e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2938158758247024e-172\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.469079379123512e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.234539689561756e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.617269844780878e-173\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.08634922390439e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.043174611952195e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0215873059760975e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0107936529880487e-174\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.053968264940244e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.526984132470122e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.263492066235061e-175\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.317460331175305e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1587301655876523e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5793650827938261e-176\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.896825413969131e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9484127069845653e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9742063534922827e-177\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.871031767461413e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.935515883730707e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4677579418653533e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2338789709326767e-178\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.169394854663383e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.084697427331692e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.542348713665846e-179\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.71174356832923e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.855871784164615e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9279358920823073e-180\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.639679460411536e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.819839730205768e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.409919865102884e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.204959932551442e-181\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.02479966275721e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.012399831378605e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5061999156893026e-182\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.530999578446513e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7654997892232564e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8827498946116282e-183\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.413749473058141e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.706874736529071e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3534373682645353e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1767186841322676e-184\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.883593420661338e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.941796710330669e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4708983551653345e-185\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.354491775826673e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6772458879133364e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8386229439566682e-186\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.193114719783341e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5965573598916705e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2982786799458352e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1491393399729176e-187\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.745696699864588e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.872848349932294e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.436424174966147e-188\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.182120874830735e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5910604374153675e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7955302187076838e-189\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.977651093538419e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4888255467692094e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2444127733846047e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1222063866923024e-190\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.611031933461512e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.805515966730756e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.402757983365378e-191\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.01378991682689e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.506894958413445e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7534474792067224e-192\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.767237396033612e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.383618698016806e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.191809349008403e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0959046745042015e-193\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.479523372521008e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.739761686260504e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.369880843130252e-194\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.84940421565126e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.42470210782563e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.712351053912815e-195\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.561755269564074e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.280877634782037e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1404388173910186e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0702194086955093e-196\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.351097043477547e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6755485217387732e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3377742608693866e-197\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.688871304346933e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3444356521734666e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6722178260867333e-198\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.361089130433666e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.180544565216833e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0902722826084166e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0451361413042083e-199\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.225680706521042e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.612840353260521e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3064201766302604e-200\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.532100883151302e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.266050441575651e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6330252207878255e-201\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.165126103939127e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.082563051969564e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.041281525984782e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.020640762992391e-202\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.103203814961955e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5516019074809773e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2758009537404886e-203\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.379004768702443e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1895023843512216e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5947511921756108e-204\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.973755960878054e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.986877980439027e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9934389902195135e-205\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.967194951097568e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.983597475548784e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.491798737774392e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.245899368887196e-206\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.22949684443598e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.11474842221799e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.557374211108995e-207\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.786871055544975e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8934355277724873e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9467177638862437e-208\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.733588819431218e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.866794409715609e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4333972048578046e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2166986024289023e-209\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.083493012144512e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.041746506072256e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.520873253036128e-210\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.60436626518064e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.80218313259032e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.90109156629516e-211\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.5054578314758e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.7527289157379e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.37636445786895e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.188182228934475e-212\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.940911144672375e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9704555723361872e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4852277861680936e-213\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.426138930840468e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.713069465420234e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.856534732710117e-214\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.282673663550585e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.641336831775293e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3206684158876463e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1603342079438231e-215\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.801671039719116e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.900835519859558e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.450417759929779e-216\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.252088799648895e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6260443998244473e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8130221999122236e-217\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.065110999561118e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.532555499780559e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2662777498902796e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1331388749451398e-218\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.665694374725699e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8328471873628494e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4164235936814247e-219\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.082117968407124e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.541058984203562e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.770529492101781e-220\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.852647460508905e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4263237302544523e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2131618651272261e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1065809325636131e-221\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.5329046628180653e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7664523314090327e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3832261657045163e-222\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.916130828522582e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.458065414261291e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7290327071306454e-223\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.645163535653227e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.322581767826614e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.161290883913307e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0806454419566534e-224\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.403227209783267e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7016136048916335e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3508068024458167e-225\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.754034012229084e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.377017006114542e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.688508503057271e-226\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.442542515286355e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2212712576431773e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1106356288215886e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0553178144107943e-227\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.276589072053972e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.638294536026986e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.319147268013493e-228\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.595736340067465e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2978681700337323e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6489340850168661e-229\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.244670425084331e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1223352125421653e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0611676062710827e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0305838031355413e-230\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.152919015677707e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5764595078388533e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2882297539194267e-231\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.441148769597133e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.220574384798567e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6102871923992833e-232\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.051435961996417e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0257179809982083e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0128589904991042e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0064294952495521e-233\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.0321474762477604e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5160737381238802e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2580368690619401e-234\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.290184345309701e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1450921726548502e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5725460863274251e-235\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.862730431637126e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.931365215818563e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9656826079092814e-236\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.828413039546407e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.914206519773204e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.457103259886602e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.228551629943301e-237\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.142758149716505e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0713790748582522e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5356895374291261e-238\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.678447687145631e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8392238435728152e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9196119217864076e-239\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.598059608932038e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.799029804466019e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3995149022330095e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1997574511165048e-240\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.998787255582524e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.999393627791262e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.499696813895631e-241\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.498484069478155e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7492420347390774e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8746210173695387e-242\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.373105086847693e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.686552543423847e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3432762717119234e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1716381358559617e-243\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.858190679279809e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9290953396399042e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4645476698199521e-244\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.322738349099761e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.6613691745498803e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8306845872749401e-245\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.153422936374701e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5767114681873503e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2883557340936752e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1441778670468376e-246\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.720889335234188e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.860444667617094e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.430222333808547e-247\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.151111669042735e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5755558345213674e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7877779172606837e-248\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.938889586303419e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.4694447931517093e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2347223965758547e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1173611982879273e-249\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.586805991439637e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7934029957198183e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3967014978599092e-250\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.983507489299546e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.491753744649773e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7458768723248864e-251\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.729384361624432e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.364692180812216e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.182346090406108e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.091173045203054e-252\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.45586522601527e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.727932613007635e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3639663065038175e-253\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.819831532519088e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.409915766259544e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.704957883129772e-254\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.52478941564886e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.26239470782443e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.131197353912215e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0655986769561075e-255\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.327993384780537e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6639966923902686e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3319983461951343e-256\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.659991730975672e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.329995865487836e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.664997932743918e-257\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.32498966371959e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.162494831859795e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0812474159298974e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0406237079649487e-258\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.2031185398247434e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.6015592699123717e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3007796349561859e-259\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.503898174780929e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2519490873904646e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6259745436952323e-260\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.129872718476162e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.064936359238081e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0324681796190404e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0162340898095202e-261\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.081170449047601e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5405852245238005e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2702926122619002e-262\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.351463061309501e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.1757315306547506e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5878657653273753e-263\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.939328826636877e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.9696644133184383e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9848322066592191e-264\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.924161033296096e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.962080516648048e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.481040258324024e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.240520129162012e-265\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.20260064581006e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.10130032290503e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.550650161452515e-266\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.753250807262575e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8766254036312874e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9383127018156437e-267\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.691563509078218e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.845781754539109e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.4228908772695546e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2114454386347773e-268\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.057227193173887e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0286135965869433e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5143067982934716e-269\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.571533991467358e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.785766995733679e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8928834978668395e-270\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.464417489334198e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.732208744667099e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3661043723335494e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1830521861667747e-271\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.915260930833874e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.957630465416937e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4788152327084684e-272\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.394076163542342e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.697038081771171e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8485190408855855e-273\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.242595204427927e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.621297602213964e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.310648801106982e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.155324400553491e-274\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.776622002767455e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8883110013837273e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4441555006918637e-275\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.220777503459318e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.610388751729659e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8051943758648296e-276\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.025971879324148e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.512985939662074e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.256492969831037e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1282464849155185e-277\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.641232424577593e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.8206162122887962e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4103081061443981e-278\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.051540530721991e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5257702653609953e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7628851326804976e-279\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.814425663402488e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.407212831701244e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.203606415850622e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.101803207925311e-280\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.509016039626555e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.7545080198132776e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3772540099066388e-281\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.886270049533194e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.443135024766597e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7215675123832985e-282\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.607837561916492e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.303918780958246e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.151959390479123e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0759796952395615e-283\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.379898476197808e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.689949238098904e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.344974619049452e-284\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.72487309524726e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.36243654762363e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.681218273811815e-285\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.406091369059075e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.2030456845295373e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1015228422647686e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0507614211323843e-286\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.253807105661922e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.626903552830961e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.3134517764154804e-287\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.567258882077402e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.283629441038701e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6418147205193505e-288\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.209073602596753e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.1045368012983762e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0522684006491881e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0261342003245941e-289\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.1306710016229703e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.5653355008114852e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.2826677504057426e-290\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.413338752028713e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2066693760143564e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6033346880071782e-291\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.016673440035891e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.008336720017946e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.004168360008973e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0020841800044864e-292\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.010420900022432e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.505210450011216e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.252605225005608e-293\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.26302612502804e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.13151306251402e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.56575653125701e-294\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.82878265628505e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.914391328142525e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9571956640712625e-295\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.785978320356312e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.892989160178156e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.446494580089078e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.223247290044539e-296\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.116236450222695e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.0581182251113476e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.5290591125556738e-297\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.645295562778369e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.8226477813891845e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.9113238906945923e-298\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.556619453472961e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.778309726736481e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3891548633682403e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1945774316841202e-299\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.972887158420601e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.9864435792103004e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4932217896051502e-300\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.466108948025751e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.7330544740128755e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8665272370064378e-301\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.332636185032189e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.6663180925160944e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.3331590462580472e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1665795231290236e-302\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.832897615645118e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.916448807822559e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.4582244039112795e-303\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.291122019556398e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.645561009778199e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.8227805048890994e-304\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 9.113902524445497e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.5569512622227484e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2784756311113742e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1392378155556871e-305\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.696189077778436e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.848094538889218e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.424047269444609e-306\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 7.120236347223045e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.5601181736115222e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.7800590868057611e-307\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.900295434028806e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.450147717014403e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.2250738585072014e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.1125369292536007e-308\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.562684646268003e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.781342323134e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.390671161567e-309\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.953355807835e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.4766779039175e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.73833895195875e-310\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.691694759794e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.345847379897e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.1729236899484e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.086461844974e-311\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.43230922487e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.716154612436e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.35807730622e-312\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.7903865311e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.39519326554e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.69759663277e-313\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.487983164e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.243991582e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.121995791e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.0609978955e-314\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.304989477e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.65249474e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.32624737e-315\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.63123685e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.3156184e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6578092e-316\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.289046e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.144523e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0722615e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.036131e-317\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.180654e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.590327e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.295163e-318\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.4758e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.2379e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.61895e-319\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8.095e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4.0474e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.0237e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.012e-320\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5.06e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2.53e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.265e-321\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 6.3e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 3.16e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1.6e-322\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 8e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 4e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 2e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 1e-323\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 5e-324\nGradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 0.0\n\n---------------------------------------------------------------------------\n\nZeroDivisionError                         Traceback (most recent call last)\n\n",
    "646541": "That means the last batch has only one input sample and batchnorm doesn't work for batch size 1 (for obvious reasons), add a check to prevent this and you'll be good. \nA tip: don't post such long error logs directly, use pastebin.",
    "647799": "Apex and multi gpu sometimes got nan output.  \nI tried [this post](https://discuss.pytorch.org/t/adam-half-precision-nans/1765). But it didn't solve.  \nNow, I don't use apex qq",
    "647634": "@mobassir Double check you do not have nans in input ... this can cause this issue"
  }
}