[terminal_command] TERMINAL ()
  Using cached ipython-9.8.0-py3-none-any.whl.metadata (4.5 kB)Collecting aiohttp (from sglang==0.5.5.post1)  Using cached aiohttp-3.13.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (8.1 kB)Collecting anthropic>=0.20.0 (from sglang==0.5.5.post1)  Using cached anthropic-0.75.0-py3-none-any.whl.metadata (28 kB)Collecting blobfile==3.0.0 (from sglang==0.5.5.post1)  Using cached blobfile-3.0.0-py3-none-any.whl.metadata (15 kB)Collecting build (from sglang==0.5.5.post1)  Using cached build-1.3.0-py3-none-any.whl.metadata (5.6 kB)Collecting compressed-tensors (from sglang==0.5.5.post1)  Using cached compressed_tensors-0.12.2-py3-none-any.whl.metadata (7.0 kB)Requirement already satisfied: cuda-python in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (12.9.1)Collecting decord2 (from sglang==0.5.5.post1)  Using cached decord2-2.0.0-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (686 bytes)Collecting datasets (from sglang==0.5.5.post1)  Using cached datasets-4.4.1-py3-none-any.whl.metadata (19 kB)Collecting einops (from sglang==0.5.5.post1)  Using cached einops-0.8.1-py3-none-any.whl.metadata (13 kB)Collecting fastapi (from sglang==0.5.5.post1)  Using cached fastapi-0.124.0-py3-none-any.whl.metadata (30 kB)Collecting flashinfer_python==0.5.0 (from sglang==0.5.5.post1)  Using cached flashinfer_python-0.5.0-py3-none-any.whl.metadata (11 kB)Collecting flashinfer_cubin==0.5.0 (from sglang==0.5.5.post1)  Using cached flashinfer_cubin-0.5.0-py3-none-any.whl.metadata (1.3 kB)Collecting gguf (from sglang==0.5.5.post1)  Using cached gguf-0.17.1-py3-none-any.whl.metadata (4.3 kB)Collecting hf_transfer (from sglang==0.5.5.post1)  Using cached hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.7 kB)Collecting huggingface_hub (from sglang==0.5.5.post1)  Using cached huggingface_hub-1.2.1-py3-none-any.whl.metadata (13 kB)Collecting interegular (from sglang==0.5.5.post1)  Using cached interegular-0.3.3-py37-none-any.whl.metadata (3.0 kB)Collecting llguidance<0.8.0,>=0.7.11 (from sglang==0.5.5.post1)  Using cached llguidance-0.7.30-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (10 kB)Collecting modelscope (from sglang==0.5.5.post1)  Using cached modelscope-1.32.0-py3-none-any.whl.metadata (43 kB)Collecting msgspec (from sglang==0.5.5.post1)  Using cached msgspec-0.20.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.5 kB)Collecting ninja (from sglang==0.5.5.post1)  Using cached ninja-1.13.0-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (5.1 kB)Requirement already satisfied: numpy in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.3.3)Collecting nvidia-cutlass-dsl==4.2.1 (from sglang==0.5.5.post1)  Using cached nvidia_cutlass_dsl-4.2.1-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (2.5 kB)Collecting openai-harmony==0.0.4 (from sglang==0.5.5.post1)  Using cached openai_harmony-0.0.4-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.0 kB)Collecting openai==2.6.1 (from sglang==0.5.5.post1)  Using cached openai-2.6.1-py3-none-any.whl.metadata (29 kB)Collecting orjson (from sglang==0.5.5.post1)  Using cached orjson-3.11.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (41 kB)Collecting outlines==0.1.11 (from sglang==0.5.5.post1)  Using cached outlines-0.1.11-py3-none-any.whl.metadata (17 kB)Collecting packaging (from sglang==0.5.5.post1)  Using cached packaging-25.0-py3-none-any.whl.metadata (3.3 kB)Collecting partial_json_parser (from sglang==0.5.5.post1)  Using cached partial_json_parser-0.2.1.1.post7-py3-none-any.whl.metadata (6.1 kB)Requirement already satisfied: pillow in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sglang==0.5.5.post1) (11.3.0)Collecting prometheus-client>=0.20.0 (from sglang==0.5.5.post1)  Using cached prometheus_client-0.23.1-py3-none-any.whl.metadata (1.9 kB)Collecting psutil (from sglang==0.5.5.post1)  Using cached psutil-7.1.3-cp36-abi3-manylinux2010_x86_64.manylinux_2_12_x86_64.manylinux_2_28_x86_64.whl.metadata (23 kB)Collecting py-spy (from sglang==0.5.5.post1)  Using cached py_spy-0.4.1-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (510 bytes)Collecting pybase64 (from sglang==0.5.5.post1)  Using cached pybase64-1.4.3-cp312-cp312-manylinux1_x86_64.manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_5_x86_64.whl.metadata (8.7 kB)Collecting pydantic (from sglang==0.5.5.post1)  Using cached pydantic-2.12.5-py3-none-any.whl.metadata (90 kB)Collecting nvidia-ml-py (from sglang==0.5.5.post1)  Using cached nvidia_ml_py-13.590.44-py3-none-any.whl.metadata (9.8 kB)Collecting python-multipart (from sglang==0.5.5.post1)  Using cached python_multipart-0.0.20-py3-none-any.whl.metadata (1.8 kB)Collecting pyzmq>=25.1.2 (from sglang==0.5.5.post1)  Using cached pyzmq-27.1.0-cp312-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl.metadata (6.0 kB)Collecting requests (from sglang==0.5.5.post1)  Using cached requests-2.32.5-py3-none-any.whl.metadata (4.9 kB)Collecting scipy (from sglang==0.5.5.post1)  Using cached scipy-1.16.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (62 kB)Collecting sentencepiece (from sglang==0.5.5.post1)  Using cached sentencepiece-0.2.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (10 kB)Collecting setproctitle (from sglang==0.5.5.post1)  Using cached setproctitle-1.3.7-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (10 kB)Collecting sgl-kernel==0.3.17 (from sglang==0.5.5.post1)  Using cached sgl_kernel-0.3.17-cp310-abi3-manylinux2014_x86_64.whl.metadata (17 kB)Collecting soundfile==0.13.1 (from sglang==0.5.5.post1)  Using cached soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl.metadata (16 kB)Collecting tiktoken (from sglang==0.5.5.post1)  Using cached tiktoken-0.12.0-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (6.7 kB)Collecting timm==1.0.16 (from sglang==0.5.5.post1)  Using cached timm-1.0.16-py3-none-any.whl.metadata (57 kB)Collecting torch_memory_saver==0.0.9 (from sglang==0.5.5.post1)  Using cached torch_memory_saver-0.0.9-cp39-abi3-manylinux2014_x86_64.whl.metadata (108 bytes)Requirement already satisfied: torch==2.8.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.8.0+cu129)Requirement already satisfied: torchaudio==2.8.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.8.0+cu129)Requirement already satisfied: torchvision in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.23.0+cu129)Collecting torchao==0.9.0 (from sglang==0.5.5.post1)  Using cached torchao-0.9.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_28_x86_64.whl.metadata (14 kB)Collecting tqdm (from sglang==0.5.5.post1)  Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)Collecting transformers==4.57.1 (from sglang==0.5.5.post1)  Using cached transformers-4.57.1-py3-none-any.whl.metadata (43 kB)Collecting uvicorn (from sglang==0.5.5.post1)  Using cached uvicorn-0.38.0-py3-none-any.whl.metadata (6.8 kB)Collecting uvloop==0.21.0 (from sglang==0.5.5.post1)  Using cached uvloop-0.21.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)Collecting xgrammar==0.1.25 (from sglang==0.5.5.post1)  Using cached xgrammar-0.1.25-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB)Collecting grpcio==1.75.1 (from sglang==0.5.5.post1)  Using cached grpcio-1.75.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (3.7 kB)Collecting grpcio-tools==1.75.1 (from sglang==0.5.5.post1)  Using cached grpcio_tools-1.75.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (5.3 kB)Collecting grpcio-reflection==1.75.1 (from sglang==0.5.5.post1)  Using cached grpcio_reflection-1.75.1-py3-none-any.whl.metadata (1.1 kB)Collecting grpcio-health-checking==1.75.1 (from sglang==0.5.5.post1)  Using cached grpcio_health_checking-1.75.1-py3-none-any.whl.metadata (1.1 kB)WARNING: sglang 0.5.5.post1 does not provide the extra 'all'Collecting pycryptodomex>=3.8 (from blobfile==3.0.0->sglang==0.5.5.post1)  Using cached pycryptodomex-3.23.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.4 kB)Collecting urllib3<3,>=1.25.3 (from blobfile==3.0.0->sglang==0.5.5.post1)  Using cached urllib3-2.6.1-py3-none-any.whl.metadata (6.6 kB)Collecting lxml>=4.9 (from blobfile==3.0.0->sglang==0.5.5.post1)  Using cached lxml-6.0.2-cp312-cp312-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl.metadata (3.6 kB)Requirement already satisfied: filelock>=3.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from blobfile==3.0.0->sglang==0.5.5.post1) (3.19.1)Collecting apache-tvm-ffi<0.2,>=0.1 (from flashinfer_python==0.5.0->sglang==0.5.5.post1)  Using cached apache_tvm_ffi-0.1.5-cp312-abi3-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (4.2 kB)Collecting click (from flashinfer_python==0.5.0->sglang==0.5.5.post1)  Using cached click-8.3.1-py3-none-any.whl.metadata (2.6 kB)Collecting nvidia-cudnn-frontend>=1.13.0 (from flashinfer_python==0.5.0->sglang==0.5.5.post1)  Using cached nvidia_cudnn_frontend-1.16.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (6.8 kB)Collecting tabulate (from flashinfer_python==0.5.0->sglang==0.5.5.post1)  Using cached tabulate-0.9.0-py3-none-any.whl.metadata (34 kB)Requirement already satisfied: typing-extensions~=4.12 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from grpcio==1.75.1->sglang==0.5.5.post1) (4.15.0)Collecting protobuf<7.0.0,>=6.31.1 (from grpcio-health-checking==1.75.1->sglang==0.5.5.post1)  Using cached protobuf-6.33.2-cp39-abi3-manylinux2014_x86_64.whl.metadata (593 bytes)Requirement already satisfied: setuptools in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from grpcio-tools==1.75.1->sglang==0.5.5.post1) (80.9.0)Collecting anyio<5,>=3.5.0 (from openai==2.6.1->sglang==0.5.5.post1)  Using cached anyio-4.12.0-py3-none-any.whl.metadata (4.3 kB)Collecting distro<2,>=1.7.0 (from openai==2.6.1->sglang==0.5.5.post1)  Using cached distro-1.9.0-py3-none-any.whl.metadata (6.8 kB)Collecting httpx<1,>=0.23.0 (from openai==2.6.1->sglang==0.5.5.post1)  Using cached httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB)Collecting jiter<1,>=0.10.0 (from openai==2.6.1->sglang==0.5.5.post1)  Using cached jiter-0.12.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.2 kB)Collecting sniffio (from openai==2.6.1->sglang==0.5.5.post1)  Using cached sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)Requirement already satisfied: jinja2 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (3.1.6)Collecting lark (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached lark-1.3.1-py3-none-any.whl.metadata (1.8 kB)Collecting nest_asyncio (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached nest_asyncio-1.6.0-py3-none-any.whl.metadata (2.8 kB)Collecting cloudpickle (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached cloudpickle-3.1.2-py3-none-any.whl.metadata (7.1 kB)Collecting diskcache (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached diskcache-5.6.3-py3-none-any.whl.metadata (20 kB)Collecting referencing (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached referencing-0.37.0-py3-none-any.whl.metadata (2.8 kB)Collecting jsonschema (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached jsonschema-4.25.1-py3-none-any.whl.metadata (7.6 kB)Collecting pycountry (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached pycountry-24.6.1-py3-none-any.whl.metadata (12 kB)Collecting airportsdata (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached airportsdata-20250909-py3-none-any.whl.metadata (9.2 kB)Collecting outlines_core==0.1.26 (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached outlines_core-0.1.26-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB)Collecting cffi>=1.0 (from soundfile==0.13.1->sglang==0.5.5.post1)  Using cached cffi-2.0.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.6 kB)Collecting pyyaml (from timm==1.0.16->sglang==0.5.5.post1)  Using cached pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.4 kB)Collecting safetensors (from timm==1.0.16->sglang==0.5.5.post1)  Using cached safetensors-0.7.0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)Requirement already satisfied: sympy>=1.13.3 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (1.14.0)Requirement already satisfied: networkx in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (3.5)Requirement already satisfied: fsspec in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (2025.9.0)Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.9.86 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.86)Requirement already satisfied: nvidia-cuda-runtime-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.79)Requirement already satisfied: nvidia-cuda-cupti-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.79)Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (9.10.2.21)Requirement already satisfied: nvidia-cublas-cu12==12.9.1.4 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.1.4)Requirement already satisfied: nvidia-cufft-cu12==11.4.1.4 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (11.4.1.4)Requirement already satisfied: nvidia-curand-cu12==10.3.10.19 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (10.3.10.19)Requirement already satisfied: nvidia-cusolver-cu12==11.7.5.82 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (11.7.5.82)Requirement already satisfied: nvidia-cusparse-cu12==12.5.10.65 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.5.10.65)Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (0.7.1)Requirement already satisfied: nvidia-nccl-cu12==2.27.3 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (2.27.3)Requirement already satisfied: nvidia-nvtx-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.79)Requirement already satisfied: nvidia-nvjitlink-cu12==12.9.86 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.86)Requirement already satisfied: nvidia-cufile-cu12==1.14.1.1 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (1.14.1.1)Requirement already satisfied: triton==3.4.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (3.4.0)Collecting huggingface_hub (from sglang==0.5.5.post1)  Using cached huggingface_hub-0.36.0-py3-none-any.whl.metadata (14 kB)Collecting regex!=2019.12.17 (from transformers==4.57.1->sglang==0.5.5.post1)  Using cached regex-2025.11.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (40 kB)Collecting tokenizers<=0.23.0,>=0.22.0 (from transformers==4.57.1->sglang==0.5.5.post1)  Using cached tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB)Collecting idna>=2.8 (from anyio<5,>=3.5.0->openai==2.6.1->sglang==0.5.5.post1)  Using cached idna-3.11-py3-none-any.whl.metadata (8.4 kB)Collecting certifi (from httpx<1,>=0.23.0->openai==2.6.1->sglang==0.5.5.post1)  Using cached certifi-2025.11.12-py3-none-any.whl.metadata (2.5 kB)Collecting httpcore==1.* (from httpx<1,>=0.23.0->openai==2.6.1->sglang==0.5.5.post1)  Using cached httpcore-1.0.9-py3-none-any.whl.metadata (21 kB)Collecting h11>=0.16 (from httpcore==1.*->httpx<1,>=0.23.0->openai==2.6.1->sglang==0.5.5.post1)  Using cached h11-0.16.0-py3-none-any.whl.metadata (8.3 kB)Collecting hf-xet<2.0.0,>=1.1.3 (from huggingface_hub->sglang==0.5.5.post1)  Using cached hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)Collecting annotated-types>=0.6.0 (from pydantic->sglang==0.5.5.post1)  Using cached annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB)Collecting pydantic-core==2.41.5 (from pydantic->sglang==0.5.5.post1)  Using cached pydantic_core-2.41.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.3 kB)Collecting typing-inspection>=0.4.2 (from pydantic->sglang==0.5.5.post1)  Using cached typing_inspection-0.4.2-py3-none-any.whl.metadata (2.6 kB)Collecting docstring-parser<1,>=0.15 (from anthropic>=0.20.0->sglang==0.5.5.post1)  Using cached docstring_parser-0.17.0-py3-none-any.whl.metadata (3.5 kB)Collecting pycparser (from cffi>=1.0->soundfile==0.13.1->sglang==0.5.5.post1)  Using cached pycparser-2.23-py3-none-any.whl.metadata (993 bytes)Requirement already satisfied: cuda-bindings~=12.9.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from cuda-python->sglang==0.5.5.post1) (12.9.4)Requirement already satisfied: cuda-pathfinder~=1.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from cuda-bindings~=12.9.1->cuda-python->sglang==0.5.5.post1) (1.3.3)Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sympy>=1.13.3->torch==2.8.0->sglang==0.5.5.post1) (1.3.0)Collecting aiohappyeyeballs>=2.5.0 (from aiohttp->sglang==0.5.5.post1)  Using cached aiohappyeyeballs-2.6.1-py3-none-any.whl.metadata (5.9 kB)Collecting aiosignal>=1.4.0 (from aiohttp->sglang==0.5.5.post1)  Using cached aiosignal-1.4.0-py3-none-any.whl.metadata (3.7 kB)Collecting attrs>=17.3.0 (from aiohttp->sglang==0.5.5.post1)  Using cached attrs-25.4.0-py3-none-any.whl.metadata (10 kB)Collecting frozenlist>=1.1.1 (from aiohttp->sglang==0.5.5.post1)  Using cached frozenlist-1.8.0-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (20 kB)Collecting multidict<7.0,>=4.5 (from aiohttp->sglang==0.5.5.post1)  Using cached multidict-6.7.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.3 kB)Collecting propcache>=0.2.0 (from aiohttp->sglang==0.5.5.post1)  Using cached propcache-0.4.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (13 kB)Collecting yarl<2.0,>=1.17.0 (from aiohttp->sglang==0.5.5.post1)  Using cached yarl-1.22.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (75 kB)Collecting pyproject_hooks (from build->sglang==0.5.5.post1)  Using cached pyproject_hooks-1.2.0-py3-none-any.whl.metadata (1.3 kB)Collecting loguru (from compressed-tensors->sglang==0.5.5.post1)  Using cached loguru-0.7.3-py3-none-any.whl.metadata (22 kB)Collecting pyarrow>=21.0.0 (from datasets->sglang==0.5.5.post1)  Using cached pyarrow-22.0.0-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (3.2 kB)Collecting dill<0.4.1,>=0.3.0 (from datasets->sglang==0.5.5.post1)  Using cached dill-0.4.0-py3-none-any.whl.metadata (10 kB)Collecting pandas (from datasets->sglang==0.5.5.post1)  Using cached pandas-2.3.3-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (91 kB)Collecting xxhash (from datasets->sglang==0.5.5.post1)  Using cached xxhash-3.6.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (13 kB)Collecting multiprocess<0.70.19 (from datasets->sglang==0.5.5.post1)  Using cached multiprocess-0.70.18-py312-none-any.whl.metadata (7.5 kB)Collecting charset_normalizer<4,>=2 (from requests->sglang==0.5.5.post1)  Using cached charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (37 kB)Collecting starlette<0.51.0,>=0.40.0 (from fastapi->sglang==0.5.5.post1)  Using cached starlette-0.50.0-py3-none-any.whl.metadata (6.3 kB)Collecting annotated-doc>=0.0.2 (from fastapi->sglang==0.5.5.post1)  Using cached annotated_doc-0.0.4-py3-none-any.whl.metadata (6.6 kB)Collecting decorator>=4.3.2 (from IPython->sglang==0.5.5.post1)  Using cached decorator-5.2.1-py3-none-any.whl.metadata (3.9 kB)Collecting ipython-pygments-lexers>=1.0.0 (from IPython->sglang==0.5.5.post1)  Using cached ipython_pygments_lexers-1.1.1-py3-none-any.whl.metadata (1.1 kB)Collecting jedi>=0.18.1 (from IPython->sglang==0.5.5.post1)  Using cached jedi-0.19.2-py2.py3-none-any.whl.metadata (22 kB)Collecting matplotlib-inline>=0.1.5 (from IPython->sglang==0.5.5.post1)  Using cached matplotlib_inline-0.2.1-py3-none-any.whl.metadata (2.3 kB)Collecting pexpect>4.3 (from IPython->sglang==0.5.5.post1)  Using cached pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB)Collecting prompt_toolkit<3.1.0,>=3.0.41 (from IPython->sglang==0.5.5.post1)  Using cached prompt_toolkit-3.0.52-py3-none-any.whl.metadata (6.4 kB)Requirement already satisfied: pygments>=2.11.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (2.19.2)Collecting stack_data>=0.6.0 (from IPython->sglang==0.5.5.post1)  Using cached stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)Collecting traitlets>=5.13.0 (from IPython->sglang==0.5.5.post1)  Using cached traitlets-5.14.3-py3-none-any.whl.metadata (10 kB)Collecting wcwidth (from prompt_toolkit<3.1.0,>=3.0.41->IPython->sglang==0.5.5.post1)  Using cached wcwidth-0.2.14-py2.py3-none-any.whl.metadata (15 kB)Collecting parso<0.9.0,>=0.8.4 (from jedi>=0.18.1->IPython->sglang==0.5.5.post1)  Using cached parso-0.8.5-py2.py3-none-any.whl.metadata (8.3 kB)Collecting ptyprocess>=0.5 (from pexpect>4.3->IPython->sglang==0.5.5.post1)  Using cached ptyprocess-0.7.0-py2.py3-none-any.whl.metadata (1.3 kB)Collecting executing>=1.2.0 (from stack_data>=0.6.0->IPython->sglang==0.5.5.post1)  Using cached executing-2.2.1-py2.py3-none-any.whl.metadata (8.9 kB)Collecting asttokens>=2.1.0 (from stack_data>=0.6.0->IPython->sglang==0.5.5.post1)  Using cached asttokens-3.0.1-py3-none-any.whl.metadata (4.9 kB)Collecting pure-eval (from stack_data>=0.6.0->IPython->sglang==0.5.5.post1)  Using cached pure_eval-0.2.3-py3-none-any.whl.metadata (6.3 kB)Requirement already satisfied: MarkupSafe>=2.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from jinja2->outlines==0.1.11->sglang==0.5.5.post1) (2.1.5)Collecting jsonschema-specifications>=2023.03.6 (from jsonschema->outlines==0.1.11->sglang==0.5.5.post1)  Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl.metadata (2.9 kB)Collecting rpds-py>=0.7.1 (from jsonschema->outlines==0.1.11->sglang==0.5.5.post1)  Using cached rpds_py-0.30.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)Collecting python-dateutil>=2.8.2 (from pandas->datasets->sglang==0.5.5.post1)  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)Collecting pytz>=2020.1 (from pandas->datasets->sglang==0.5.5.post1)  Using cached pytz-2025.2-py2.py3-none-any.whl.metadata (22 kB)Collecting tzdata>=2022.7 (from pandas->datasets->sglang==0.5.5.post1)  Using cached tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB)Collecting six>=1.5 (from python-dateutil>=2.8.2->pandas->datasets->sglang==0.5.5.post1)  Using cached six-1.17.0-py2.py3-none-any.whl.metadata (1.7 kB)Using cached blobfile-3.0.0-py3-none-any.whl (75 kB)Using cached flashinfer_cubin-0.5.0-py3-none-any.whl (91.3 MB)Using cached flashinfer_python-0.5.0-py3-none-any.whl (6.9 MB)Using cached grpcio-1.75.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (6.4 MB)Using cached grpcio_health_checking-1.75.1-py3-none-any.whl (18 kB)Using cached grpcio_reflection-1.75.1-py3-none-any.whl (22 kB)Using cached grpcio_tools-1.75.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (2.7 MB)Using cached nvidia_cutlass_dsl-4.2.1-cp312-cp312-manylinux_2_28_x86_64.whl (62.2 MB)Using cached openai-2.6.1-py3-none-any.whl (1.0 MB)Using cached openai_harmony-0.0.4-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)Using cached outlines-0.1.11-py3-none-any.whl (87 kB)Using cached outlines_core-0.1.26-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (343 kB)Using cached sgl_kernel-0.3.17-cp310-abi3-manylinux2014_x86_64.whl (511.4 MB)Using cached soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl (1.3 MB)Using cached timm-1.0.16-py3-none-any.whl (2.5 MB)Using cached torch_memory_saver-0.0.9-cp39-abi3-manylinux2014_x86_64.whl (488 kB)Using cached torchao-0.9.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_28_x86_64.whl (5.7 MB)Using cached transformers-4.57.1-py3-none-any.whl (12.0 MB)Using cached uvloop-0.21.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)Using cached xgrammar-0.1.25-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.7 MB)Using cached anyio-4.12.0-py3-none-any.whl (113 kB)Using cached apache_tvm_ffi-0.1.5-cp312-abi3-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (2.0 MB)Using cached distro-1.9.0-py3-none-any.whl (20 kB)Using cached httpx-0.28.1-py3-none-any.whl (73 kB)Using cached httpcore-1.0.9-py3-none-any.whl (78 kB)Using cached huggingface_hub-0.36.0-py3-none-any.whl (566 kB)Using cached hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)Using cached jiter-0.12.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (361 kB)Using cached llguidance-0.7.30-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (15.0 MB)Using cached protobuf-6.33.2-cp39-abi3-manylinux2014_x86_64.whl (323 kB)Using cached pydantic-2.12.5-py3-none-any.whl (463 kB)Using cached pydantic_core-2.41.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB)Using cached tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)Using cached urllib3-2.6.1-py3-none-any.whl (131 kB)Using cached annotated_types-0.7.0-py3-none-any.whl (13 kB)Using cached anthropic-0.75.0-py3-none-any.whl (388 kB)Using cached docstring_parser-0.17.0-py3-none-any.whl (36 kB)Using cached cffi-2.0.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (219 kB)Using cached h11-0.16.0-py3-none-any.whl (37 kB)Using cached idna-3.11-py3-none-any.whl (71 kB)Using cached lxml-6.0.2-cp312-cp312-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (5.3 MB)Using cached nvidia_cudnn_frontend-1.16.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (2.0 MB)Using cached packaging-25.0-py3-none-any.whl (66 kB)Using cached prometheus_client-0.23.1-py3-none-any.whl (61 kB)Using cached pycryptodomex-3.23.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB)Using cached pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (807 kB)Using cached pyzmq-27.1.0-cp312-abi3-manylinux_2_26_x86_64.manylinux_2_28_x86_64.whl (840 kB)Using cached regex-2025.11.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (803 kB)Using cached safetensors-0.7.0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (507 kB)Using cached tqdm-4.67.1-py3-none-any.whl (78 kB)Using cached typing_inspection-0.4.2-py3-none-any.whl (14 kB)Using cached aiohttp-3.13.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (1.8 MB)Using cached multidict-6.7.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (256 kB)Using cached yarl-1.22.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (377 kB)Using cached aiohappyeyeballs-2.6.1-py3-none-any.whl (15 kB)Using cached aiosignal-1.4.0-py3-none-any.whl (7.5 kB)Using cached attrs-25.4.0-py3-none-any.whl (67 kB)Using cached frozenlist-1.8.0-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (242 kB)Using cached propcache-0.4.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (221 kB)Using cached airportsdata-20250909-py3-none-any.whl (914 kB)Using cached build-1.3.0-py3-none-any.whl (23 kB)Using cached certifi-2025.11.12-py3-none-any.whl (159 kB)Using cached click-8.3.1-py3-none-any.whl (108 kB)Using cached cloudpickle-3.1.2-py3-none-any.whl (22 kB)Using cached compressed_tensors-0.12.2-py3-none-any.whl (183 kB)Using cached datasets-4.4.1-py3-none-any.whl (511 kB)Using cached dill-0.4.0-py3-none-any.whl (119 kB)Using cached multiprocess-0.70.18-py312-none-any.whl (150 kB)Using cached pyarrow-22.0.0-cp312-cp312-manylinux_2_28_x86_64.whl (47.7 MB)Using cached requests-2.32.5-py3-none-any.whl (64 kB)Using cached charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (153 kB)Using cached decord2-2.0.0-cp312-cp312-manylinux_2_28_x86_64.whl (32.3 MB)Using cached diskcache-5.6.3-py3-none-any.whl (45 kB)Using cached einops-0.8.1-py3-none-any.whl (64 kB)Using cached fastapi-0.124.0-py3-none-any.whl (112 kB)Using cached starlette-0.50.0-py3-none-any.whl (74 kB)Using cached annotated_doc-0.0.4-py3-none-any.whl (5.3 kB)Using cached gguf-0.17.1-py3-none-any.whl (96 kB)Using cached hf_transfer-0.1.9-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB)Using cached interegular-0.3.3-py37-none-any.whl (23 kB)Using cached ipython-9.8.0-py3-none-any.whl (621 kB)Using cached prompt_toolkit-3.0.52-py3-none-any.whl (391 kB)Using cached decorator-5.2.1-py3-none-any.whl (9.2 kB)Using cached ipython_pygments_lexers-1.1.1-py3-none-any.whl (8.1 kB)Using cached jedi-0.19.2-py2.py3-none-any.whl (1.6 MB)Using cached parso-0.8.5-py2.py3-none-any.whl (106 kB)Using cached matplotlib_inline-0.2.1-py3-none-any.whl (9.5 kB)Using cached pexpect-4.9.0-py2.py3-none-any.whl (63 kB)Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)Using cached stack_data-0.6.3-py3-none-any.whl (24 kB)Using cached asttokens-3.0.1-py3-none-any.whl (27 kB)Using cached executing-2.2.1-py2.py3-none-any.whl (28 kB)Using cached traitlets-5.14.3-py3-none-any.whl (85 kB)Using cached jsonschema-4.25.1-py3-none-any.whl (90 kB)Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl (18 kB)Using cached referencing-0.37.0-py3-none-any.whl (26 kB)Using cached rpds_py-0.30.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (394 kB)Using cached lark-1.3.1-py3-none-any.whl (113 kB)Using cached loguru-0.7.3-py3-none-any.whl (61 kB)Using cached modelscope-1.32.0-py3-none-any.whl (6.0 MB)Using cached msgspec-0.20.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (224 kB)Using cached nest_asyncio-1.6.0-py3-none-any.whl (5.2 kB)Using cached ninja-1.13.0-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (180 kB)Using cached nvidia_ml_py-13.590.44-py3-none-any.whl (50 kB)Using cached orjson-3.11.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (139 kB)Using cached pandas-2.3.3-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (12.4 MB)Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)Using cached pytz-2025.2-py2.py3-none-any.whl (509 kB)Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)Using cached tzdata-2025.2-py2.py3-none-any.whl (347 kB)Using cached partial_json_parser-0.2.1.1.post7-py3-none-any.whl (10 kB)Using cached psutil-7.1.3-cp36-abi3-manylinux2010_x86_64.manylinux_2_12_x86_64.manylinux_2_28_x86_64.whl (263 kB)Using cached pure_eval-0.2.3-py3-none-any.whl (11 kB)Using cached py_spy-0.4.1-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (2.8 MB)Using cached pybase64-1.4.3-cp312-cp312-manylinux1_x86_64.manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_5_x86_64.whl (71 kB)Using cached pycountry-24.6.1-py3-none-any.whl (6.3 MB)Using cached pycparser-2.23-py3-none-any.whl (118 kB)Using cached pyproject_hooks-1.2.0-py3-none-any.whl (10 kB)Using cached python_multipart-0.0.20-py3-none-any.whl (24 kB)Using cached scipy-1.16.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (35.7 MB)Using cached sentencepiece-0.2.1-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (1.4 MB)Using cached setproctitle-1.3.7-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (32 kB)Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)Using cached tabulate-0.9.0-py3-none-any.whl (35 kB)Using cached tiktoken-0.12.0-cp312-cp312-manylinux_2_28_x86_64.whl (1.2 MB)Using cached uvicorn-0.38.0-py3-none-any.whl (68 kB)Using cached wcwidth-0.2.14-py2.py3-none-any.whl (37 kB)Using cached xxhash-3.6.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (193 kB)Building wheels for collected packages: sglang  Building editable for sglang (pyproject.toml) ... done  Created wheel for sglang: filename=sglang-0.5.5.post1-0.editable-py3-none-any.whl size=4892 sha256=219037649791a9cdf5a2bb0bc20e215c060e4afd83089a25597171493f4e82e2  Stored in directory: /var/tmp/pip-ephem-wheel-cache-e09i6cz_/wheels/46/d0/34/909c7f4d7ef9f77f91f900aadda21234359d9f95bf8b98fbdaSuccessfully built sglangInstalling collected packages: torchao, pytz, py-spy, pure-eval, ptyprocess, nvidia-ml-py, xxhash, wcwidth, uvloop, urllib3, tzdata, typing-inspection, traitlets, tqdm, torch_memory_saver, tabulate, sniffio, six, sgl-kernel, setproctitle, sentencepiece, scipy, safetensors, rpds-py, regex, pyzmq, pyyaml, python-multipart, pyproject_hooks, pydantic-core, pycryptodomex, pycparser, pycountry, pybase64, pyarrow, psutil, protobuf, propcache, prometheus-client, pexpect, partial_json_parser, parso, packaging, orjson, nvidia-cudnn-frontend, ninja, nest_asyncio, multidict, msgspec, lxml, loguru, llguidance, lark, jiter, ipython-pygments-lexers, interegular, idna, hf-xet, hf_transfer, h11, grpcio, frozenlist, flashinfer_cubin, executing, einops, docstring-parser, distro, diskcache, dill, decord2, decorator, cloudpickle, click, charset_normalizer, certifi, attrs, asttokens, apache-tvm-ffi, annotated-types, annotated-doc, airportsdata, aiohappyeyeballs, yarl, uvicorn, stack_data, requests, referencing, python-dateutil, pydantic, prompt_toolkit, multiprocess, matplotlib-inline, jedi, httpcore, grpcio-tools, grpcio-reflection, grpcio-health-checking, gguf, cffi, build, blobfile, anyio, aiosignal, tiktoken, starlette, soundfile, pandas, openai-harmony, nvidia-cutlass-dsl, modelscope, jsonschema-specifications, IPython, huggingface_hub, httpx, aiohttp, tokenizers, openai, jsonschema, flashinfer_python, fastapi, anthropic, transformers, timm, outlines_core, datasets, xgrammar, outlines, compressed-tensors, sglang   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╸━━━━━━ 109/129 [modelscope]srun: forcing job terminationTerminatedsalloc: Job allocation 36127 has been revoked.                                              [mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles] $ srun: Job step aborted: Waiting up to 32 seconds for job step to finish.[2025-12-09T19:30:01.465] error: *** STEP 36127.interactive ON hai005 FAILED (non-zero exit code or other failure mode) ***[2025-12-09T19:30:01.465] error: *** REASON: RaisedSignal:15(Terminated) ***srun: forcing job terminationsrun: error: hai005: task 0: Killed(miles) [mihir.mahajan@hai005.haicore.berlin:~/Projects/miles] $ salloc --time=02:00:00 --gres=gpu:2 --nodes=1 --ntasks-per-node=4 --mem=200G --qos=low --nodelist=hai005salloc: Granted job allocation 36129salloc: Nodes hai005 are ready for jobRunning inside SLURM, Job ID 36129.[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles_bak] $ ^C[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles_bak] $ ^C[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles_bak] $ ^C[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles_bak] $ exitsrun: error: hai005: task 0: Exited with exit code 130salloc: Relinquishing job allocation 36129(miles) [mihir.mahajan@hai005.haicore.berlin:~/Projects/miles] $ salloc --time=02:00:00 --gres=gpu:2 --nodes=1 --ntasks-per-node=4 --mem=200G --qos=low --nodelist=hai005salloc: Granted job allocation 36130salloc: Nodes hai005 are ready for jobRunning inside SLURM, Job ID 36130.[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles_bak] $ cd ../miles[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles] $ micromamba activate miles(miles) [mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles] $ conda deactivate[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles] $ sh build_conda.shRunning inside SLURM, Job ID 36130.conda-forge/linux-64                                        Using cacheconda-forge/noarch                                          Using cachenodefaults/noarch                                   ??.?MB @  ??.?MB/s  0.1snodefaults/linux-64                                125.0 B @ 364.0 B/s  0.1sPinned packages:  - python=3.12Transaction  Prefix: /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles  All requested packages already installedTransaction startingTransaction finishedconda-forge/linux-64                                        Using cacheconda-forge/noarch                                          Using cachenodefaults/linux-64                                         Using cachenodefaults/noarch                                           Using cachePinned packages:  - python=3.12Transaction  Prefix: /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles  All requested packages already installedTransaction startingTransaction finishedRequirement already satisfied: cuda-python==12.9.1 in ./micromamba/envs/miles/lib/python3.12/site-packages (12.9.1)Requirement already satisfied: cuda-bindings~=12.9.1 in ./micromamba/envs/miles/lib/python3.12/site-packages (from cuda-python==12.9.1) (12.9.4)Requirement already satisfied: cuda-pathfinder~=1.1 in ./micromamba/envs/miles/lib/python3.12/site-packages (from cuda-bindings~=12.9.1->cuda-python==12.9.1) (1.3.3)Looking in indexes: https://download.pytorch.org/whl/cu129Requirement already satisfied: torch==2.8.0 in ./micromamba/envs/miles/lib/python3.12/site-packages (2.8.0+cu129)Requirement already satisfied: torchvision==0.23.0 in ./micromamba/envs/miles/lib/python3.12/site-packages (0.23.0+cu129)Requirement already satisfied: torchaudio==2.8.0 in ./micromamba/envs/miles/lib/python3.12/site-packages (2.8.0+cu129)Requirement already satisfied: filelock in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (3.19.1)Requirement already satisfied: typing-extensions>=4.10.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (4.15.0)Requirement already satisfied: setuptools in ./micromamba/envs/miles/lib/python3.12/site-packages (from torch==2.8.0) (80.9.0)Requirement already satisfied: sympy>=1.13.3 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (1.14.0)Requirement already satisfied: networkx in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (3.5)Requirement already satisfied: jinja2 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (3.1.6)Requirement already satisfied: fsspec in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (2025.9.0)Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.9.86 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.9.86)Requirement already satisfied: nvidia-cuda-runtime-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.9.79)Requirement already satisfied: nvidia-cuda-cupti-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.9.79)Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (9.10.2.21)Requirement already satisfied: nvidia-cublas-cu12==12.9.1.4 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.9.1.4)Requirement already satisfied: nvidia-cufft-cu12==11.4.1.4 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (11.4.1.4)Requirement already satisfied: nvidia-curand-cu12==10.3.10.19 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (10.3.10.19)Requirement already satisfied: nvidia-cusolver-cu12==11.7.5.82 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (11.7.5.82)Requirement already satisfied: nvidia-cusparse-cu12==12.5.10.65 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.5.10.65)Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (0.7.1)Requirement already satisfied: nvidia-nccl-cu12==2.27.3 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (2.27.3)Requirement already satisfied: nvidia-nvtx-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.9.79)Requirement already satisfied: nvidia-nvjitlink-cu12==12.9.86 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (12.9.86)Requirement already satisfied: nvidia-cufile-cu12==1.14.1.1 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (1.14.1.1)Requirement already satisfied: triton==3.4.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0) (3.4.0)Requirement already satisfied: numpy in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torchvision==0.23.0) (2.3.3)Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torchvision==0.23.0) (11.3.0)Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sympy>=1.13.3->torch==2.8.0) (1.3.0)Requirement already satisfied: MarkupSafe>=2.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from jinja2->torch==2.8.0) (2.1.5)M       python/sglang/srt/distributed/device_communicators/pynccl.pyM       python/sglang/srt/distributed/device_communicators/pynccl_wrapper.pyM       python/sglang/srt/distributed/parallel_state.pyM       python/sglang/srt/entrypoints/engine.pyM       python/sglang/srt/entrypoints/http_server.pyM       python/sglang/srt/layers/layernorm.pyM       python/sglang/srt/layers/logits_processor.pyM       python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.pyM       python/sglang/srt/layers/moe/topk.pyM       python/sglang/srt/layers/rotary_embedding.pyM       python/sglang/srt/layers/sampler.pyM       python/sglang/srt/managers/detokenizer_manager.pyM       python/sglang/srt/managers/io_struct.pyM       python/sglang/srt/managers/schedule_batch.pyM       python/sglang/srt/managers/scheduler.pyM       python/sglang/srt/managers/scheduler_output_processor_mixin.pyM       python/sglang/srt/managers/scheduler_runtime_checker_mixin.pyM       python/sglang/srt/managers/scheduler_update_weights_mixin.pyM       python/sglang/srt/managers/tokenizer_manager.pyM       python/sglang/srt/mem_cache/memory_pool.pyM       python/sglang/srt/model_executor/model_runner.pyM       python/sglang/srt/models/deepseek_v2.pyM       python/sglang/srt/models/ernie4.pyM       python/sglang/srt/models/glm4_moe.pyM       python/sglang/srt/models/gpt_oss.pyM       python/sglang/srt/models/grok.pyM       python/sglang/srt/models/hunyuan.pyM       python/sglang/srt/models/longcat_flash.pyM       python/sglang/srt/models/qwen2.pyM       python/sglang/srt/models/qwen2_moe.pyM       python/sglang/srt/models/qwen3.pyM       python/sglang/srt/models/qwen3_moe.pyM       python/sglang/srt/models/step3_vl.pyM       python/sglang/srt/server_args.pyM       python/sglang/srt/speculative/eagle_info.pyM       python/sglang/srt/speculative/eagle_worker.pyM       python/sglang/srt/weight_sync/tensor_bucket.pyHEAD is now at 303cc957e chore: bump SGLang version to 0.5.5.post1 (#13000)Obtaining file:///fast/project/HFMI_SynergyUnit/mihir/sglang/python  Installing build dependencies ... done  Checking if build backend supports build_editable ... done  Getting requirements to build editable ... done  Preparing editable metadata (pyproject.toml) ... doneCollecting IPython (from sglang==0.5.5.post1)  Using cached ipython-9.8.0-py3-none-any.whl.metadata (4.5 kB)Collecting aiohttp (from sglang==0.5.5.post1)  Using cached aiohttp-3.13.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (8.1 kB)Collecting anthropic>=0.20.0 (from sglang==0.5.5.post1)  Using cached anthropic-0.75.0-py3-none-any.whl.metadata (28 kB)Requirement already satisfied: blobfile==3.0.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (3.0.0)Requirement already satisfied: build in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.3.0)Collecting compressed-tensors (from sglang==0.5.5.post1)  Using cached compressed_tensors-0.12.2-py3-none-any.whl.metadata (7.0 kB)Requirement already satisfied: cuda-python in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (12.9.1)Requirement already satisfied: decord2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.0.0)Collecting datasets (from sglang==0.5.5.post1)  Using cached datasets-4.4.1-py3-none-any.whl.metadata (19 kB)Requirement already satisfied: einops in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.8.1)Collecting fastapi (from sglang==0.5.5.post1)  Using cached fastapi-0.124.0-py3-none-any.whl.metadata (30 kB)Collecting flashinfer_python==0.5.0 (from sglang==0.5.5.post1)  Using cached flashinfer_python-0.5.0-py3-none-any.whl.metadata (11 kB)Requirement already satisfied: flashinfer_cubin==0.5.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.5.0)Requirement already satisfied: gguf in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.17.1)Requirement already satisfied: hf_transfer in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.1.9)Collecting huggingface_hub (from sglang==0.5.5.post1)  Using cached huggingface_hub-1.2.1-py3-none-any.whl.metadata (13 kB)Requirement already satisfied: interegular in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.3.3)Requirement already satisfied: llguidance<0.8.0,>=0.7.11 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.7.30)Requirement already satisfied: modelscope in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.32.0)Requirement already satisfied: msgspec in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.20.0)Requirement already satisfied: ninja in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.13.0)Requirement already satisfied: numpy in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.3.3)Requirement already satisfied: nvidia-cutlass-dsl==4.2.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (4.2.1)Requirement already satisfied: openai-harmony==0.0.4 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.0.4)Collecting openai==2.6.1 (from sglang==0.5.5.post1)  Using cached openai-2.6.1-py3-none-any.whl.metadata (29 kB)Requirement already satisfied: orjson in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (3.11.5)Collecting outlines==0.1.11 (from sglang==0.5.5.post1)  Using cached outlines-0.1.11-py3-none-any.whl.metadata (17 kB)Requirement already satisfied: packaging in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (25.0)Requirement already satisfied: partial_json_parser in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.2.1.1.post7)Requirement already satisfied: pillow in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sglang==0.5.5.post1) (11.3.0)Requirement already satisfied: prometheus-client>=0.20.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.23.1)Requirement already satisfied: psutil in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (7.1.3)Requirement already satisfied: py-spy in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.4.1)Requirement already satisfied: pybase64 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.4.3)Requirement already satisfied: pydantic in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.12.5)Requirement already satisfied: nvidia-ml-py in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (13.590.44)Requirement already satisfied: python-multipart in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.0.20)Requirement already satisfied: pyzmq>=25.1.2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (27.1.0)Requirement already satisfied: requests in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.32.5)Requirement already satisfied: scipy in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.16.3)Requirement already satisfied: sentencepiece in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.2.1)Requirement already satisfied: setproctitle in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.3.7)Requirement already satisfied: sgl-kernel==0.3.17 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.3.17)Requirement already satisfied: soundfile==0.13.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.13.1)Requirement already satisfied: tiktoken in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.12.0)Collecting timm==1.0.16 (from sglang==0.5.5.post1)  Using cached timm-1.0.16-py3-none-any.whl.metadata (57 kB)Requirement already satisfied: torch_memory_saver==0.0.9 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.0.9)Requirement already satisfied: torch==2.8.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.8.0+cu129)Requirement already satisfied: torchaudio==2.8.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (2.8.0+cu129)Requirement already satisfied: torchvision in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.23.0+cu129)Requirement already satisfied: torchao==0.9.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.9.0)Requirement already satisfied: tqdm in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (4.67.1)Collecting transformers==4.57.1 (from sglang==0.5.5.post1)  Using cached transformers-4.57.1-py3-none-any.whl.metadata (43 kB)Requirement already satisfied: uvicorn in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.38.0)Requirement already satisfied: uvloop==0.21.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (0.21.0)Collecting xgrammar==0.1.25 (from sglang==0.5.5.post1)  Using cached xgrammar-0.1.25-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB)Requirement already satisfied: grpcio==1.75.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.75.1)Requirement already satisfied: grpcio-tools==1.75.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.75.1)Requirement already satisfied: grpcio-reflection==1.75.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.75.1)Requirement already satisfied: grpcio-health-checking==1.75.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from sglang==0.5.5.post1) (1.75.1)WARNING: sglang 0.5.5.post1 does not provide the extra 'all'Requirement already satisfied: pycryptodomex>=3.8 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from blobfile==3.0.0->sglang==0.5.5.post1) (3.23.0)Requirement already satisfied: urllib3<3,>=1.25.3 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from blobfile==3.0.0->sglang==0.5.5.post1) (2.6.1)Requirement already satisfied: lxml>=4.9 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from blobfile==3.0.0->sglang==0.5.5.post1) (6.0.2)Requirement already satisfied: filelock>=3.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from blobfile==3.0.0->sglang==0.5.5.post1) (3.19.1)Requirement already satisfied: apache-tvm-ffi<0.2,>=0.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from flashinfer_python==0.5.0->sglang==0.5.5.post1) (0.1.5)Requirement already satisfied: click in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from flashinfer_python==0.5.0->sglang==0.5.5.post1) (8.3.1)Requirement already satisfied: nvidia-cudnn-frontend>=1.13.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from flashinfer_python==0.5.0->sglang==0.5.5.post1) (1.16.0)Requirement already satisfied: tabulate in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from flashinfer_python==0.5.0->sglang==0.5.5.post1) (0.9.0)Requirement already satisfied: typing-extensions~=4.12 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from grpcio==1.75.1->sglang==0.5.5.post1) (4.15.0)Requirement already satisfied: protobuf<7.0.0,>=6.31.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from grpcio-health-checking==1.75.1->sglang==0.5.5.post1) (6.33.2)Requirement already satisfied: setuptools in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from grpcio-tools==1.75.1->sglang==0.5.5.post1) (80.9.0)Requirement already satisfied: anyio<5,>=3.5.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from openai==2.6.1->sglang==0.5.5.post1) (4.12.0)Requirement already satisfied: distro<2,>=1.7.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from openai==2.6.1->sglang==0.5.5.post1) (1.9.0)Collecting httpx<1,>=0.23.0 (from openai==2.6.1->sglang==0.5.5.post1)  Using cached httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB)Requirement already satisfied: jiter<1,>=0.10.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from openai==2.6.1->sglang==0.5.5.post1) (0.12.0)Requirement already satisfied: sniffio in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from openai==2.6.1->sglang==0.5.5.post1) (1.3.1)Requirement already satisfied: jinja2 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (3.1.6)Requirement already satisfied: lark in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (1.3.1)Requirement already satisfied: nest_asyncio in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (1.6.0)Requirement already satisfied: cloudpickle in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (3.1.2)Requirement already satisfied: diskcache in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (5.6.3)Requirement already satisfied: referencing in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (0.37.0)Collecting jsonschema (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached jsonschema-4.25.1-py3-none-any.whl.metadata (7.6 kB)Requirement already satisfied: pycountry in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (24.6.1)Requirement already satisfied: airportsdata in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from outlines==0.1.11->sglang==0.5.5.post1) (20250909)Collecting outlines_core==0.1.26 (from outlines==0.1.11->sglang==0.5.5.post1)  Using cached outlines_core-0.1.26-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB)Requirement already satisfied: cffi>=1.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from soundfile==0.13.1->sglang==0.5.5.post1) (2.0.0)Requirement already satisfied: pyyaml in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from timm==1.0.16->sglang==0.5.5.post1) (6.0.3)Requirement already satisfied: safetensors in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from timm==1.0.16->sglang==0.5.5.post1) (0.7.0)Requirement already satisfied: sympy>=1.13.3 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (1.14.0)Requirement already satisfied: networkx in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (3.5)Requirement already satisfied: fsspec in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (2025.9.0)Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.9.86 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.86)Requirement already satisfied: nvidia-cuda-runtime-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.79)Requirement already satisfied: nvidia-cuda-cupti-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.79)Requirement already satisfied: nvidia-cudnn-cu12==9.10.2.21 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (9.10.2.21)Requirement already satisfied: nvidia-cublas-cu12==12.9.1.4 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.1.4)Requirement already satisfied: nvidia-cufft-cu12==11.4.1.4 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (11.4.1.4)Requirement already satisfied: nvidia-curand-cu12==10.3.10.19 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (10.3.10.19)Requirement already satisfied: nvidia-cusolver-cu12==11.7.5.82 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (11.7.5.82)Requirement already satisfied: nvidia-cusparse-cu12==12.5.10.65 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.5.10.65)Requirement already satisfied: nvidia-cusparselt-cu12==0.7.1 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (0.7.1)Requirement already satisfied: nvidia-nccl-cu12==2.27.3 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (2.27.3)Requirement already satisfied: nvidia-nvtx-cu12==12.9.79 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.79)Requirement already satisfied: nvidia-nvjitlink-cu12==12.9.86 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (12.9.86)Requirement already satisfied: nvidia-cufile-cu12==1.14.1.1 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (1.14.1.1)Requirement already satisfied: triton==3.4.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from torch==2.8.0->sglang==0.5.5.post1) (3.4.0)Collecting huggingface_hub (from sglang==0.5.5.post1)  Using cached huggingface_hub-0.36.0-py3-none-any.whl.metadata (14 kB)Requirement already satisfied: regex!=2019.12.17 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from transformers==4.57.1->sglang==0.5.5.post1) (2025.11.3)Collecting tokenizers<=0.23.0,>=0.22.0 (from transformers==4.57.1->sglang==0.5.5.post1)  Using cached tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB)Requirement already satisfied: idna>=2.8 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from anyio<5,>=3.5.0->openai==2.6.1->sglang==0.5.5.post1) (3.11)Requirement already satisfied: certifi in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from httpx<1,>=0.23.0->openai==2.6.1->sglang==0.5.5.post1) (2025.11.12)Requirement already satisfied: httpcore==1.* in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from httpx<1,>=0.23.0->openai==2.6.1->sglang==0.5.5.post1) (1.0.9)Requirement already satisfied: h11>=0.16 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from httpcore==1.*->httpx<1,>=0.23.0->openai==2.6.1->sglang==0.5.5.post1) (0.16.0)Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from huggingface_hub->sglang==0.5.5.post1) (1.2.0)Requirement already satisfied: annotated-types>=0.6.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pydantic->sglang==0.5.5.post1) (0.7.0)Requirement already satisfied: pydantic-core==2.41.5 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pydantic->sglang==0.5.5.post1) (2.41.5)Requirement already satisfied: typing-inspection>=0.4.2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pydantic->sglang==0.5.5.post1) (0.4.2)Requirement already satisfied: docstring-parser<1,>=0.15 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from anthropic>=0.20.0->sglang==0.5.5.post1) (0.17.0)Requirement already satisfied: pycparser in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from cffi>=1.0->soundfile==0.13.1->sglang==0.5.5.post1) (2.23)Requirement already satisfied: cuda-bindings~=12.9.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from cuda-python->sglang==0.5.5.post1) (12.9.4)Requirement already satisfied: cuda-pathfinder~=1.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from cuda-bindings~=12.9.1->cuda-python->sglang==0.5.5.post1) (1.3.3)Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from sympy>=1.13.3->torch==2.8.0->sglang==0.5.5.post1) (1.3.0)Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (2.6.1)Requirement already satisfied: aiosignal>=1.4.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (1.4.0)Requirement already satisfied: attrs>=17.3.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (25.4.0)Requirement already satisfied: frozenlist>=1.1.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (1.8.0)Requirement already satisfied: multidict<7.0,>=4.5 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (6.7.0)Requirement already satisfied: propcache>=0.2.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (0.4.1)Requirement already satisfied: yarl<2.0,>=1.17.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from aiohttp->sglang==0.5.5.post1) (1.22.0)Requirement already satisfied: pyproject_hooks in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from build->sglang==0.5.5.post1) (1.2.0)Requirement already satisfied: loguru in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from compressed-tensors->sglang==0.5.5.post1) (0.7.3)Requirement already satisfied: pyarrow>=21.0.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from datasets->sglang==0.5.5.post1) (22.0.0)Requirement already satisfied: dill<0.4.1,>=0.3.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from datasets->sglang==0.5.5.post1) (0.4.0)Requirement already satisfied: pandas in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from datasets->sglang==0.5.5.post1) (2.3.3)Requirement already satisfied: xxhash in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from datasets->sglang==0.5.5.post1) (3.6.0)Requirement already satisfied: multiprocess<0.70.19 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from datasets->sglang==0.5.5.post1) (0.70.18)Requirement already satisfied: charset_normalizer<4,>=2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from requests->sglang==0.5.5.post1) (3.4.4)Requirement already satisfied: starlette<0.51.0,>=0.40.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from fastapi->sglang==0.5.5.post1) (0.50.0)Requirement already satisfied: annotated-doc>=0.0.2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from fastapi->sglang==0.5.5.post1) (0.0.4)Requirement already satisfied: decorator>=4.3.2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (5.2.1)Requirement already satisfied: ipython-pygments-lexers>=1.0.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (1.1.1)Requirement already satisfied: jedi>=0.18.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (0.19.2)Requirement already satisfied: matplotlib-inline>=0.1.5 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (0.2.1)Requirement already satisfied: pexpect>4.3 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (4.9.0)Requirement already satisfied: prompt_toolkit<3.1.0,>=3.0.41 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (3.0.52)Requirement already satisfied: pygments>=2.11.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (2.19.2)Requirement already satisfied: stack_data>=0.6.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (0.6.3)Requirement already satisfied: traitlets>=5.13.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from IPython->sglang==0.5.5.post1) (5.14.3)Requirement already satisfied: wcwidth in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from prompt_toolkit<3.1.0,>=3.0.41->IPython->sglang==0.5.5.post1) (0.2.14)Requirement already satisfied: parso<0.9.0,>=0.8.4 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from jedi>=0.18.1->IPython->sglang==0.5.5.post1) (0.8.5)Requirement already satisfied: ptyprocess>=0.5 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pexpect>4.3->IPython->sglang==0.5.5.post1) (0.7.0)Requirement already satisfied: executing>=1.2.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from stack_data>=0.6.0->IPython->sglang==0.5.5.post1) (2.2.1)Requirement already satisfied: asttokens>=2.1.0 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from stack_data>=0.6.0->IPython->sglang==0.5.5.post1) (3.0.1)Requirement already satisfied: pure-eval in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from stack_data>=0.6.0->IPython->sglang==0.5.5.post1) (0.2.3)Requirement already satisfied: MarkupSafe>=2.0 in /home/mihir.mahajan/.local/lib/python3.12/site-packages (from jinja2->outlines==0.1.11->sglang==0.5.5.post1) (2.1.5)Collecting jsonschema-specifications>=2023.03.6 (from jsonschema->outlines==0.1.11->sglang==0.5.5.post1)  Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl.metadata (2.9 kB)Requirement already satisfied: rpds-py>=0.7.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from jsonschema->outlines==0.1.11->sglang==0.5.5.post1) (0.30.0)Requirement already satisfied: python-dateutil>=2.8.2 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pandas->datasets->sglang==0.5.5.post1) (2.9.0.post0)Requirement already satisfied: pytz>=2020.1 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pandas->datasets->sglang==0.5.5.post1) (2025.2)Requirement already satisfied: tzdata>=2022.7 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from pandas->datasets->sglang==0.5.5.post1) (2025.2)Requirement already satisfied: six>=1.5 in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (from python-dateutil>=2.8.2->pandas->datasets->sglang==0.5.5.post1) (1.17.0)Using cached flashinfer_python-0.5.0-py3-none-any.whl (6.9 MB)Using cached openai-2.6.1-py3-none-any.whl (1.0 MB)Using cached outlines-0.1.11-py3-none-any.whl (87 kB)Using cached outlines_core-0.1.26-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (343 kB)Using cached timm-1.0.16-py3-none-any.whl (2.5 MB)Using cached transformers-4.57.1-py3-none-any.whl (12.0 MB)Using cached xgrammar-0.1.25-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.7 MB)Using cached httpx-0.28.1-py3-none-any.whl (73 kB)Using cached huggingface_hub-0.36.0-py3-none-any.whl (566 kB)Using cached tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)Using cached anthropic-0.75.0-py3-none-any.whl (388 kB)Using cached aiohttp-3.13.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (1.8 MB)Using cached compressed_tensors-0.12.2-py3-none-any.whl (183 kB)Using cached datasets-4.4.1-py3-none-any.whl (511 kB)Using cached fastapi-0.124.0-py3-none-any.whl (112 kB)Using cached ipython-9.8.0-py3-none-any.whl (621 kB)Using cached jsonschema-4.25.1-py3-none-any.whl (90 kB)Using cached jsonschema_specifications-2025.9.1-py3-none-any.whl (18 kB)Building wheels for collected packages: sglang  Building editable for sglang (pyproject.toml) ... done  Created wheel for sglang: filename=sglang-0.5.5.post1-0.editable-py3-none-any.whl size=4892 sha256=44656a886017ba755ec1d9187ed991bb219911eba3e6f6c44c32ed860021475b  Stored in directory: /var/tmp/pip-ephem-wheel-cache-fvb0tm2d/wheels/46/d0/34/909c7f4d7ef9f77f91f900aadda21234359d9f95bf8b98fbdaSuccessfully built sglangInstalling collected packages: jsonschema-specifications, IPython, huggingface_hub, httpx, aiohttp, tokenizers, openai, jsonschema, fastapi, anthropic, transformers, outlines_core, flashinfer_python, datasets, xgrammar, timm, outlines, compressed-tensors, sglangSuccessfully installed IPython-9.8.0 aiohttp-3.13.2 anthropic-0.75.0 compressed-tensors-0.12.2 datasets-4.4.1 fastapi-0.124.0 flashinfer_python-0.5.0 httpx-0.28.1 huggingface_hub-0.36.0 jsonschema-4.25.1 jsonschema-specifications-2025.9.1 openai-2.6.1 outlines-0.1.11 outlines_core-0.1.26 sglang-0.5.5.post1 timm-1.0.16 tokenizers-0.22.1 transformers-4.57.1 xgrammar-0.1.25Collecting cmake  Using cached cmake-4.2.0-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (6.5 kB)Requirement already satisfied: ninja in /fast/project/HFMI_SynergyUnit/mihir/micromamba/envs/miles/lib/python3.12/site-packages (1.13.0)Using cached cmake-4.2.0-py3-none-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (28.9 MB)Installing collected packages: cmakeSuccessfully installed cmake-4.2.0[mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles] $ micromamba activate milesp(miles) [mihir.mahajan@hai005.haicore.berlin:/fast/home/mihir.mahajan/Projects/miles] $ pythonPython 3.12.12 | packaged by conda-forge | (main, Oct 22 2025, 23:25:55) [GCC 14.3.0] on linuxType "help", "copyright", "credits" or "license" for more information.Ctrl click to launch VS Code Native REPL