ohjuny's picture
TGI/vLLM benchmarking (#34)
c5e73ca unverified
argparse
asyncio
aiohttp
numpy
torch==2.0.1 --index-url https://download.pytorch.org/whl/cu118
tqdm
zeus-ml