Spaces:

ysharma
/

Explore_llamav2_with_TGI

Running on CPU Upgrade

Amazing inference speed

#77

by hexing1994 - opened Jul 28, 2023

Jul 28, 2023

The inference speed is amazing for the Llama 2 70B model! Could you please share the spec of the server you are using? Are you running on GPU?

hexing1994 changed discussion status to closed Jul 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment