08:51:33 out/nemotron-3-ultra-550b-a55b_T1_baseline_r1.json 32.3 s 1524
08:51:48 out/nemotron-3-ultra-550b-a55b_T1_ponytail_r1.json 15.3 s 286
08:52:05 out/nemotron-3-ultra-550b-a55b_T2_baseline_r1.json 17.4 s 1090
08:52:10 out/nemotron-3-ultra-550b-a55b_T2_ponytail_r1.json 4.6 s 120
08:52:24 out/nemotron-3-ultra-550b-a55b_T3_baseline_r1.json 14.5 s 697
08:52:30 out/nemotron-3-ultra-550b-a55b_T3_ponytail_r1.json 5.3 s 140
08:52:39 out/nemotron-3-ultra-550b-a55b_T4_baseline_r1.json 9.0 s 379
08:52:42 out/nemotron-3-ultra-550b-a55b_T4_ponytail_r1.json 3.2 s 199
08:53:04 out/nemotron-3-ultra-550b-a55b_T5_baseline_r1.json 22.0 s 653
08:53:09 out/nemotron-3-ultra-550b-a55b_T5_ponytail_r1.json 5.5 s 314
08:53:29 out/nemotron-3-ultra-550b-a55b_T1_baseline_r2.json 19.6 s 1470
08:53:40 out/nemotron-3-ultra-550b-a55b_T1_ponytail_r2.json 11.2 s 306
08:53:43 out/nemotron-3-ultra-550b-a55b_T2_baseline_r2.json 3.0 s 256
08:53:55 out/nemotron-3-ultra-550b-a55b_T2_ponytail_r2.json 12.0 s 184
08:54:07 out/nemotron-3-ultra-550b-a55b_T3_baseline_r2.json 11.9 s 597
08:54:11 out/nemotron-3-ultra-550b-a55b_T3_ponytail_r2.json 3.7 s 110
08:54:29 out/nemotron-3-ultra-550b-a55b_T4_baseline_r2.json 18.2 s 332
08:54:34 out/nemotron-3-ultra-550b-a55b_T4_ponytail_r2.json 4.8 s 210
08:54:41 out/nemotron-3-ultra-550b-a55b_T5_baseline_r2.json 6.9 s 416
08:54:45 out/nemotron-3-ultra-550b-a55b_T5_ponytail_r2.json 4.4 s 247
08:54:48 out/gemma-4-31b-it_T1_baseline_r1.json ERROR HTTP 429: b'{"error":{"message":"Provider returned error","code":429,"metadata":{"raw":"google/gemma-4-31b-it:free is temporarily rate-limited upstream. Please retry shortly, or add your own key to accumulate your rate limits: https://openrouter.ai/settings/integrations","provider_name":"Google AI Studio","is_b'
08:55:08 out/gemma-4-31b-it_T1_ponytail_r1.json ERROR HTTP 429: b'{"error":{"message":"Provider returned error","code":429,"metadata":{"raw":"google/gemma-4-31b-it:free is temporarily rate-limited upstream. Please retry shortly, or add your own key to accumulate your rate limits: https://openrouter.ai/settings/integrations","provider_name":"Google AI Studio","is_b'
08:55:29 out/gemma-4-31b-it_T2_baseline_r1.json ERROR HTTP 429: b'{"error":{"message":"Provider returned error","code":429,"metadata":{"raw":"google/gemma-4-31b-it:free is temporarily rate-limited upstream. Please retry shortly, or add your own key to accumulate your rate limits: https://openrouter.ai/settings/integrations","provider_name":"Google AI Studio","is_b'
08:55:49 out/gemma-4-31b-it_T2_ponytail_r1.json ERROR HTTP 429: b'{"error":{"message":"Provider returned error","code":429,"metadata":{"raw":"google/gemma-4-31b-it:free is temporarily rate-limited upstream. Please retry shortly, or add your own key to accumulate your rate limits: https://openrouter.ai/settings/integrations","provider_name":"Google AI Studio","is_b'
08:56:01 out/dots-3-note-preview_T1_baseline_r1.json 11.1 s 912
08:56:11 out/dots-3-note-preview_T1_ponytail_r1.json 10.4 s 752
08:56:18 out/dots-3-note-preview_T2_baseline_r1.json 6.3 s 465
08:56:26 out/dots-3-note-preview_T2_ponytail_r1.json 8.3 s 633
08:56:32 out/dots-3-note-preview_T3_baseline_r1.json 6.6 s 490
08:56:36 out/dots-3-note-preview_T3_ponytail_r1.json 3.8 s 195
08:56:44 out/dots-3-note-preview_T4_baseline_r1.json 7.8 s 561
08:56:50 out/dots-3-note-preview_T4_ponytail_r1.json 6.2 s 437
08:57:55 out/dots-3-note-preview_T5_baseline_r1.json 64.7 s 6098
08:58:09 out/dots-3-note-preview_T5_ponytail_r1.json 14.5 s 1179