How to use from
LemonadeRun and chat with the model
lemonade run user.GOT-OCR2_0-716M-BF16-GGUF-BF16List all available models
lemonade listQuick Links
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Release
- 2024.10.16: GOT-OCR2_0-716M-BF16-GGUF
Description
gguf-py is a Python package for writing binary files in the GGUF based on llama_cpp.
Usage
python convert_hf_to_gguf.py --outtype bf16 --model ~/GOT-OCR2_0 --outfile ~/output/GOT-OCR2_0-GGUF
Adding Supported Model
Continue...
References
llama.cpp: LLM inference in C/C++.
GOT-OCR2.0: Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model.
- Downloads last month
- 139
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Pull the model
# Download Lemonade from https://lemonade-server.ai/lemonade pull Jerry666/GOT-OCR2_0-716M-BF16-GGUF:BF16