llama-fp16-engine / 7b-sq-int8kv-tp8 /llama_float16_tp8_rank4.engine
pankajroark's picture
update engine with inflight options for 7b-sq-int8kv-tp8
ad987a1
This file is stored with Git LFS . It is too big to display, but you can still download it.

Git LFS Details

  • SHA256: 61cc22967c7a6f2096e6e470bb6c2e9536d16f48613f4c8d2741f0d014a07163
  • Pointer size: 135 Bytes
  • Size of remote file: 1.11 GB

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.