deploy on RTX6000 pro

by meffdata - opened 7 days ago

This repo explains how to run this model in 8 rtxpro 6000: https://github.com/meffdata-bit/step5-vllm-sm120

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment