will llamacpp version will be available ?
#1
by
YairFr
- opened
since ctransformers don't have currently gpu support models other than llama & falcon - its not really performant with starcoderplus
Have you looked into this: https://github.com/ggerganov/ggml/tree/master/examples/starcoder