pankajroark
/

llama-fp16-engine

Model card Files Files and versions Community

llama-fp16-engine / 7b-sq-int8kv-tp8 /model.cache

pankajroark's picture

update engine with inflight options for 7b-sq-int8kv-tp8

ad987a1 about 1 year ago

history contribute delete

109 kB

This file contains binary data. It cannot be displayed, but you can still download it.