Hugging Face's logo

Jerry666
/
GOT-OCR2_0-716M-BF16-GGUF

GGUF
Inference Endpoints
Model card Files Community
1

Inference example

#1
by royshilkrot - opened
Discussion
royshilkrot

Hi Can you please share example code of inference with llama.cpp or llama-cpp-python? Thanks

calvinchaochao

I dont think it is runnable, since llama-cpp dosn't support its arch and tokenizer

Jerry666
 Owner

Hi Can you please share example code of inference with llama.cpp or llama-cpp-python? Thanks

Code for llama.cpp&llama-cpp-python support is under development. Thanks for your attention

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment