Hugging Face's logo

Jerry666
/
GOT-OCR2_0-716M-BF16-GGUF

GGUF
Model card Files
xet
 Community
1
How to use from
llama.cpp
Install (macOS, Linux) 
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
# Run inference directly in the terminal:
llama cli -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
Install from WinGet (Windows) 
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
# Run inference directly in the terminal:
llama cli -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
Use pre-built binary 
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
# Run inference directly in the terminal:
./llama-cli -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
Build from source code 
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
Use Docker 
docker model run hf.co/Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16
Quick Links

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Release

Description

gguf-py is a Python package for writing binary files in the GGUF based on llama_cpp.

Usage

python convert_hf_to_gguf.py --outtype bf16 --model ~/GOT-OCR2_0 --outfile ~/output/GOT-OCR2_0-GGUF

Adding Supported Model

GOT_OCR2

Continue...

References

llama.cpp: LLM inference in C/C++.

GOT-OCR2.0: Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model.

Downloads last month
137
GGUF
Model size
0.7B params
Architecture
got-ocr2_0
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support