[content] /p/project1/envcomp/mihir/logs/eval/eval_miles_run/eval_miles_run_13057326.log (log)
[2026-01-04 17:10:27] INFO utils.py:148: Note: detected 96 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable.
[2026-01-04 17:10:27] INFO utils.py:151: Note: NumExpr detected 96 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 16.
[2026-01-04 17:10:27] INFO utils.py:164: NumExpr defaulting to 16 threads.
[2026-01-04 17:10:28] INFO utils.py:148: Note: detected 96 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable.
[2026-01-04 17:10:28] INFO utils.py:151: Note: NumExpr detected 96 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 16.
[2026-01-04 17:10:28] INFO utils.py:164: NumExpr defaulting to 16 threads.
[2026-01-04 17:10:28] INFO utils.py:148: Note: detected 96 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable.
[2026-01-04 17:10:28] INFO utils.py:151: Note: NumExpr detected 96 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 16.
[2026-01-04 17:10:28] INFO utils.py:164: NumExpr defaulting to 16 threads.
[2026-01-04 17:10:28] INFO utils.py:148: Note: detected 96 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable.
[2026-01-04 17:10:28] INFO utils.py:151: Note: NumExpr detected 96 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 16.
[2026-01-04 17:10:28] INFO utils.py:164: NumExpr defaulting to 16 threads.
[2026-01-04 17:10:28] INFO utils.py:148: Note: detected 96 virtual cores but NumExpr set to maximum of 64, check "NUMEXPR_MAX_THREADS" environment variable.
[2026-01-04 17:10:28] INFO utils.py:151: Note: NumExpr detected 96 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 16.
[2026-01-04 17:10:28] INFO utils.py:164: NumExpr defaulting to 16 threads.
[2026-01-04 17:10:31 TP1] Init torch distributed begin.
[2026-01-04 17:10:31 TP2] Init torch distributed begin.
[2026-01-04 17:10:31 TP0] Init torch distributed begin.
[2026-01-04 17:10:31 TP3] Init torch distributed begin.
[W104 17:10:31.993537766 socket.cpp:767] [c10d] The client socket cannot be initialized to connect to [localhost.localdomain]:30370 (errno: 97 - Address family not supported by protocol).
[W104 17:10:32.415684383 socket.cpp:767] [c10d] The client socket cannot be initialized to connect to [localhost.localdomain]:30370 (errno: 97 - Address family not supported by protocol).
[W104 17:10:32.425859530 socket.cpp:767] [c10d] The client socket cannot be initialized to connect to [localhost.localdomain]:30370 (errno: 97 - Address family not supported by protocol).
[W104 17:10:32.437912284 socket.cpp:767] [c10d] The client socket cannot be initialized to connect to [localhost.localdomain]:30370 (errno: 97 - Address family not supported by protocol).
[Gloo] Rank 2 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 0 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 3 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 1 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 0 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 1 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 2 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 3 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[2026-01-04 17:10:33 TP0] sglang is using nccl==2.27.5
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 0 peer ranks. Expected number of connected peer ranks is : 0
[Gloo] Rank 0 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 2 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 1 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 3 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[2026-01-04 17:10:33 TP2] Init torch distributed ends. mem usage=1.01 GB
[2026-01-04 17:10:33 TP3] Init torch distributed ends. mem usage=1.08 GB
[2026-01-04 17:10:33 TP0] Init torch distributed ends. mem usage=1.01 GB
[2026-01-04 17:10:33 TP1] Init torch distributed ends. mem usage=1.08 GB
[2026-01-04 17:10:36 TP3] Ignore import error when loading sglang.srt.models.glmasr: cannot import name 'GlmAsrConfig' from 'transformers' (/p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/transformers/__init__.py)
[2026-01-04 17:10:36 TP0] Ignore import error when loading sglang.srt.models.glmasr: cannot import name 'GlmAsrConfig' from 'transformers' (/p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/transformers/__init__.py)
[2026-01-04 17:10:36 TP2] Ignore import error when loading sglang.srt.models.glmasr: cannot import name 'GlmAsrConfig' from 'transformers' (/p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/transformers/__init__.py)
[2026-01-04 17:10:36 TP1] Ignore import error when loading sglang.srt.models.glmasr: cannot import name 'GlmAsrConfig' from 'transformers' (/p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/transformers/__init__.py)
[2026-01-04 17:10:36 TP3] Load weight begin. avail mem=37.99 GB
[2026-01-04 17:10:36 TP0] Load weight begin. avail mem=38.06 GB
[2026-01-04 17:10:36 TP2] Load weight begin. avail mem=38.06 GB

Loading safetensors checkpoint shards:   0% Completed | 0/16 [00:00<?, ?it/s]
[2026-01-04 17:10:36 TP1] Load weight begin. avail mem=37.99 GB

Loading safetensors checkpoint shards:   6% Completed | 1/16 [00:01<00:21,  1.45s/it]

Loading safetensors checkpoint shards:  12% Completed | 2/16 [00:02<00:20,  1.50s/it]

Loading safetensors checkpoint shards:  19% Completed | 3/16 [00:04<00:19,  1.51s/it]

Loading safetensors checkpoint shards:  25% Completed | 4/16 [00:06<00:18,  1.51s/it]

Loading safetensors checkpoint shards:  31% Completed | 5/16 [00:07<00:16,  1.51s/it]

Loading safetensors checkpoint shards:  38% Completed | 6/16 [00:09<00:15,  1.50s/it]

Loading safetensors checkpoint shards:  44% Completed | 7/16 [00:10<00:13,  1.51s/it]

Loading safetensors checkpoint shards:  50% Completed | 8/16 [00:12<00:12,  1.51s/it]

Loading safetensors checkpoint shards:  56% Completed | 9/16 [00:13<00:10,  1.50s/it]

Loading safetensors checkpoint shards:  62% Completed | 10/16 [00:15<00:08,  1.50s/it]

Loading safetensors checkpoint shards:  69% Completed | 11/16 [00:16<00:07,  1.50s/it]

Loading safetensors checkpoint shards:  75% Completed | 12/16 [00:17<00:05,  1.46s/it]

Loading safetensors checkpoint shards:  81% Completed | 13/16 [00:19<00:04,  1.46s/it]

Loading safetensors checkpoint shards:  88% Completed | 14/16 [00:20<00:02,  1.47s/it]

Loading safetensors checkpoint shards:  94% Completed | 15/16 [00:22<00:01,  1.47s/it]

Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:22<00:00,  1.12s/it]

Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:22<00:00,  1.41s/it]

[2026-01-04 17:10:59 TP0] Load weight end. type=Qwen3MoeForCausalLM, dtype=torch.bfloat16, avail mem=23.75 GB, mem usage=14.31 GB.
[2026-01-04 17:10:59 TP3] Load weight end. type=Qwen3MoeForCausalLM, dtype=torch.bfloat16, avail mem=23.68 GB, mem usage=14.31 GB.
[2026-01-04 17:10:59 TP2] Load weight end. type=Qwen3MoeForCausalLM, dtype=torch.bfloat16, avail mem=23.75 GB, mem usage=14.31 GB.
[2026-01-04 17:11:00 TP1] Load weight end. type=Qwen3MoeForCausalLM, dtype=torch.bfloat16, avail mem=23.68 GB, mem usage=14.31 GB.
[2026-01-04 17:11:00 TP0] Using KV cache dtype: torch.bfloat16
[2026-01-04 17:11:00 TP3] KV Cache is allocated. #tokens: 619690, K size: 7.09 GB, V size: 7.09 GB
[2026-01-04 17:11:00 TP3] Memory pool end. avail mem=8.80 GB
[2026-01-04 17:11:00 TP0] KV Cache is allocated. #tokens: 619690, K size: 7.09 GB, V size: 7.09 GB
[2026-01-04 17:11:00 TP0] Memory pool end. avail mem=8.88 GB
[2026-01-04 17:11:00 TP1] KV Cache is allocated. #tokens: 619690, K size: 7.09 GB, V size: 7.09 GB
[2026-01-04 17:11:00 TP2] KV Cache is allocated. #tokens: 619690, K size: 7.09 GB, V size: 7.09 GB
[2026-01-04 17:11:00 TP2] Memory pool end. avail mem=8.88 GB
[2026-01-04 17:11:00 TP1] Memory pool end. avail mem=8.80 GB
[2026-01-04 17:11:00 TP3] Capture cuda graph begin. This can take up to several minutes. avail mem=8.29 GB
[2026-01-04 17:11:00 TP2] Capture cuda graph begin. This can take up to several minutes. avail mem=8.37 GB
[2026-01-04 17:11:00 TP0] Capture cuda graph begin. This can take up to several minutes. avail mem=8.37 GB
[2026-01-04 17:11:00 TP0] Capture cuda graph bs [1, 2, 4, 8, 12, 16, 24, 32, 40, 48, 56, 64, 72, 80, 88, 96, 104, 112, 120, 128, 136, 144, 152, 160]
[2026-01-04 17:11:00 TP1] Capture cuda graph begin. This can take up to several minutes. avail mem=8.29 GB

  0%|          | 0/24 [00:00<?, ?it/s]
Capturing batches (bs=160 avail_mem=8.25 GB):   0%|          | 0/24 [00:00<?, ?it/s][2026-01-04 17:11:02 TP3] Using default MoE kernel config. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:02 TP3] Using MoE kernel config with down_moe=False. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB_down.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:02 TP2] Using default MoE kernel config. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:02 TP2] Using MoE kernel config with down_moe=False. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB_down.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:03 TP0] Using default MoE kernel config. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:03 TP0] Using MoE kernel config with down_moe=False. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB_down.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:03 TP1] Using default MoE kernel config. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton
[2026-01-04 17:11:03 TP1] Using MoE kernel config with down_moe=False. Performance might be sub-optimal! Config file not found at /p/project1/envcomp/mahajan1/miles/tab-model-eval/.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=128,N=192,device_name=NVIDIA_A100-SXM4-40GB_down.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton

Capturing batches (bs=160 avail_mem=8.25 GB):   4%|▍         | 1/24 [00:02<01:02,  2.70s/it]
Capturing batches (bs=152 avail_mem=8.09 GB):   4%|▍         | 1/24 [00:02<01:02,  2.70s/it]
Capturing batches (bs=152 avail_mem=8.09 GB):   8%|▊         | 2/24 [00:02<00:27,  1.27s/it]
Capturing batches (bs=144 avail_mem=8.06 GB):   8%|▊         | 2/24 [00:02<00:27,  1.27s/it]
Capturing batches (bs=144 avail_mem=8.06 GB):  12%|█▎        | 3/24 [00:03<00:16,  1.31it/s]
Capturing batches (bs=136 avail_mem=8.06 GB):  12%|█▎        | 3/24 [00:03<00:16,  1.31it/s]
Capturing batches (bs=136 avail_mem=8.06 GB):  17%|█▋        | 4/24 [00:03<00:10,  1.90it/s]
Capturing batches (bs=128 avail_mem=8.03 GB):  17%|█▋        | 4/24 [00:03<00:10,  1.90it/s]
Capturing batches (bs=128 avail_mem=8.03 GB):  21%|██        | 5/24 [00:03<00:07,  2.50it/s]
Capturing batches (bs=120 avail_mem=8.02 GB):  21%|██        | 5/24 [00:03<00:07,  2.50it/s]
Capturing batches (bs=120 avail_mem=8.02 GB):  25%|██▌       | 6/24 [00:03<00:05,  3.13it/s]
Capturing batches (bs=112 avail_mem=7.99 GB):  25%|██▌       | 6/24 [00:03<00:05,  3.13it/s]
Capturing batches (bs=112 avail_mem=7.99 GB):  29%|██▉       | 7/24 [00:03<00:04,  3.74it/s]
Capturing batches (bs=104 avail_mem=7.99 GB):  29%|██▉       | 7/24 [00:03<00:04,  3.74it/s]
Capturing batches (bs=104 avail_mem=7.99 GB):  33%|███▎      | 8/24 [00:03<00:03,  4.27it/s]
Capturing batches (bs=96 avail_mem=7.96 GB):  33%|███▎      | 8/24 [00:03<00:03,  4.27it/s] 
Capturing batches (bs=96 avail_mem=7.96 GB):  38%|███▊      | 9/24 [00:04<00:03,  4.69it/s]
Capturing batches (bs=88 avail_mem=7.95 GB):  38%|███▊      | 9/24 [00:04<00:03,  4.69it/s]
Capturing batches (bs=88 avail_mem=7.95 GB):  42%|████▏     | 10/24 [00:04<00:02,  5.08it/s]
Capturing batches (bs=80 avail_mem=7.92 GB):  42%|████▏     | 10/24 [00:04<00:02,  5.08it/s]
Capturing batches (bs=80 avail_mem=7.92 GB):  46%|████▌     | 11/24 [00:04<00:02,  5.40it/s]
Capturing batches (bs=72 avail_mem=7.91 GB):  46%|████▌     | 11/24 [00:04<00:02,  5.40it/s]
Capturing batches (bs=72 avail_mem=7.91 GB):  50%|█████     | 12/24 [00:04<00:02,  5.64it/s]
Capturing batches (bs=64 avail_mem=7.89 GB):  50%|█████     | 12/24 [00:04<00:02,  5.64it/s]
Capturing batches (bs=64 avail_mem=7.89 GB):  54%|█████▍    | 13/24 [00:04<00:01,  5.78it/s]
Capturing batches (bs=56 avail_mem=7.88 GB):  54%|█████▍    | 13/24 [00:04<00:01,  5.78it/s]
Capturing batches (bs=56 avail_mem=7.88 GB):  58%|█████▊    | 14/24 [00:04<00:01,  5.89it/s]
Capturing batches (bs=48 avail_mem=7.85 GB):  58%|█████▊    | 14/24 [00:04<00:01,  5.89it/s]
Capturing batches (bs=48 avail_mem=7.85 GB):  62%|██████▎   | 15/24 [00:05<00:01,  5.96it/s]
Capturing batches (bs=40 avail_mem=7.84 GB):  62%|██████▎   | 15/24 [00:05<00:01,  5.96it/s]
Capturing batches (bs=40 avail_mem=7.84 GB):  67%|██████▋   | 16/24 [00:05<00:01,  6.06it/s]
Capturing batches (bs=32 avail_mem=7.81 GB):  67%|██████▋   | 16/24 [00:05<00:01,  6.06it/s]
Capturing batches (bs=32 avail_mem=7.81 GB):  71%|███████   | 17/24 [00:05<00:01,  5.24it/s]
Capturing batches (bs=24 avail_mem=7.80 GB):  71%|███████   | 17/24 [00:05<00:01,  5.24it/s]
Capturing batches (bs=24 avail_mem=7.80 GB):  75%|███████▌  | 18/24 [00:05<00:01,  4.53it/s]
Capturing batches (bs=16 avail_mem=7.78 GB):  75%|███████▌  | 18/24 [00:05<00:01,  4.53it/s]
Capturing batches (bs=16 avail_mem=7.78 GB):  79%|███████▉  | 19/24 [00:06<00:01,  4.47it/s]
Capturing batches (bs=12 avail_mem=7.77 GB):  79%|███████▉  | 19/24 [00:06<00:01,  4.47it/s]
Capturing batches (bs=12 avail_mem=7.77 GB):  83%|████████▎ | 20/24 [00:06<00:00,  4.77it/s]
Capturing batches (bs=8 avail_mem=7.74 GB):  83%|████████▎ | 20/24 [00:06<00:00,  4.77it/s] 
Capturing batches (bs=8 avail_mem=7.74 GB):  88%|████████▊ | 21/24 [00:06<00:00,  4.99it/s]
Capturing batches (bs=4 avail_mem=7.73 GB):  88%|████████▊ | 21/24 [00:06<00:00,  4.99it/s]
Capturing batches (bs=4 avail_mem=7.73 GB):  92%|█████████▏| 22/24 [00:06<00:00,  5.21it/s]
Capturing batches (bs=2 avail_mem=7.71 GB):  92%|█████████▏| 22/24 [00:06<00:00,  5.21it/s]
Capturing batches (bs=2 avail_mem=7.71 GB):  96%|█████████▌| 23/24 [00:06<00:00,  5.39it/s]
Capturing batches (bs=1 avail_mem=7.70 GB):  96%|█████████▌| 23/24 [00:06<00:00,  5.39it/s]
Capturing batches (bs=1 avail_mem=7.70 GB): 100%|██████████| 24/24 [00:07<00:00,  4.56it/s]
Capturing batches (bs=1 avail_mem=7.70 GB): 100%|██████████| 24/24 [00:07<00:00,  3.42it/s]
[2026-01-04 17:11:07 TP0] Registering 2328 cuda graph addresses
[2026-01-04 17:11:08 TP2] Capture cuda graph end. Time elapsed: 7.79 s. mem usage=0.70 GB. avail mem=7.67 GB.
[2026-01-04 17:11:08 TP3] Capture cuda graph end. Time elapsed: 7.86 s. mem usage=0.70 GB. avail mem=7.60 GB.
[2026-01-04 17:11:08 TP0] Capture cuda graph end. Time elapsed: 7.85 s. mem usage=0.70 GB. avail mem=7.67 GB.
[2026-01-04 17:11:08 TP1] Capture cuda graph end. Time elapsed: 8.01 s. mem usage=0.70 GB. avail mem=7.60 GB.
[2026-01-04 17:11:08 TP0] max_total_num_tokens=619690, chunked_prefill_size=4096, max_prefill_tokens=16384, max_running_requests=4096, context_len=40960, available_gpu_mem=7.67 GB
[2026-01-04 17:11:09] INFO:     Started server process [621210]
[2026-01-04 17:11:09] INFO:     Waiting for application startup.
[2026-01-04 17:11:09] Using default chat sampling params from model generation config: {'repetition_penalty': 1.0, 'temperature': 0.6, 'top_k': 20, 'top_p': 0.95}
[2026-01-04 17:11:09] Using default chat sampling params from model generation config: {'repetition_penalty': 1.0, 'temperature': 0.6, 'top_k': 20, 'top_p': 0.95}
[2026-01-04 17:11:09] INFO:     Application startup complete.
[2026-01-04 17:11:09] INFO:     Uvicorn running on http://localhost:30000 (Press CTRL+C to quit)
[2026-01-04 17:11:10] INFO:     127.0.0.1:57652 - "GET /model_info HTTP/1.1" 200 OK
[2026-01-04 17:11:10 TP0] Prefill batch, #new-seq: 1, #new-token: 6, #cached-token: 0, token usage: 0.00, #running-req: 0, #queue-req: 0, 
[2026-01-04 17:11:10] INFO:     127.0.0.1:57664 - "POST /generate HTTP/1.1" 200 OK
[2026-01-04 17:11:10] The server is fired up and ready to roll!