ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Andrei Panferov commited on Jan 18, 2024

Commit

7e4a8ff

·

1 Parent(s): c0d7cc2

flat

Files changed (5) hide show

src/__init__.py → __init__.py +0 -0
src/inference.py → inference.py +0 -0
{src/inference_kernels → inference_kernels}/router.py +0 -0
{src/inference_kernels → inference_kernels}/triton_kernel.py +0 -0
src/utils.py → utils.py +0 -0

src/__init__.py → __init__.py RENAMED Viewed

File without changes

src/inference.py → inference.py RENAMED Viewed

File without changes

{src/inference_kernels → inference_kernels}/router.py RENAMED Viewed

File without changes

{src/inference_kernels → inference_kernels}/triton_kernel.py RENAMED Viewed

File without changes

src/utils.py → utils.py RENAMED Viewed

File without changes