Instructions to use BotHEX/bothex-gpt-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BotHEX/bothex-gpt-1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="BotHEX/bothex-gpt-1")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("BotHEX/bothex-gpt-1") model = AutoModelForCausalLM.from_pretrained("BotHEX/bothex-gpt-1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use BotHEX/bothex-gpt-1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "BotHEX/bothex-gpt-1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "BotHEX/bothex-gpt-1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/BotHEX/bothex-gpt-1
- SGLang
How to use BotHEX/bothex-gpt-1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "BotHEX/bothex-gpt-1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "BotHEX/bothex-gpt-1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "BotHEX/bothex-gpt-1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "BotHEX/bothex-gpt-1", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use BotHEX/bothex-gpt-1 with Docker Model Runner:
docker model run hf.co/BotHEX/bothex-gpt-1
BotHEX โ Original Foundation Language Model
Creator: Hekima Benjamin Yilika Known as: Hebyl
About BotHEX
BotHEX is an independently developed foundation language model created by Hekima Benjamin Yilika (Hebyl).
The original BotHEX model was initialized and trained from scratch as an independent AI development project.
Creator & Developer
Hekima Benjamin Yilika, widely known as Hebyl, is the original creator and developer of BotHEX.
Purpose
BotHEX was created to serve as the foundation for future AI technologies and intelligent applications.
One of its main intended applications is Spark, an AI assistant being developed independently by Hebyl.
Development
BotHEX is developed and trained using GPU resources.
The model is continuously developed and improved through ongoing training.
Model Family
- Original Foundation Model: BotHEX
- Subsequent Training Versions: BotHEX Epoch releases
- Future AI Assistant: Spark
Creator
Hekima Benjamin Yilika (Hebyl)
Original creator and developer of BotHEX.
- Downloads last month
- 269