Instructions to use cs-552-2026-RatGPT/general_knowledge_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use cs-552-2026-RatGPT/general_knowledge_model with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="cs-552-2026-RatGPT/general_knowledge_model")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("cs-552-2026-RatGPT/general_knowledge_model")
model = AutoModelForMultimodalLM.from_pretrained("cs-552-2026-RatGPT/general_knowledge_model")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use cs-552-2026-RatGPT/general_knowledge_model with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cs-552-2026-RatGPT/general_knowledge_model"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-RatGPT/general_knowledge_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/cs-552-2026-RatGPT/general_knowledge_model

SGLang

How to use cs-552-2026-RatGPT/general_knowledge_model with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "cs-552-2026-RatGPT/general_knowledge_model" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-RatGPT/general_knowledge_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "cs-552-2026-RatGPT/general_knowledge_model" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-RatGPT/general_knowledge_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use cs-552-2026-RatGPT/general_knowledge_model with Docker Model Runner:
```
docker model run hf.co/cs-552-2026-RatGPT/general_knowledge_model
```

Automated MNLP evaluation report (2026-06-11)

by zechen-nlp - opened May 13

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

+112

-0

Automated MNLP evaluation report (2026-05-13)ac8c4b6d

zechen-nlp

May 13

Posted by the course CI pipeline.

Update Automated MNLP evaluation report (2026-05-13)01f7a704

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-13) to Automated MNLP evaluation report (2026-05-16) May 16

Update Automated MNLP evaluation report (2026-05-16)0ed24ebb

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-16) to Automated MNLP evaluation report (2026-05-17) May 17

Update Automated MNLP evaluation report (2026-05-17)9cc9198f

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-17) to Automated MNLP evaluation report (2026-05-18) May 18

Update Automated MNLP evaluation report (2026-05-18)3476688c

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-18) to Automated MNLP evaluation report (2026-05-19) May 19

Update Automated MNLP evaluation report (2026-05-19)280e95df

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-19) to Automated MNLP evaluation report (2026-05-20) May 20

Update Automated MNLP evaluation report (2026-05-20)32d20fd5

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-20) to Automated MNLP evaluation report (2026-05-21) about 1 month ago

Update Automated MNLP evaluation report (2026-05-21)620ea283

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-21) to Automated MNLP evaluation report (2026-05-22) 29 days ago

Update Automated MNLP evaluation report (2026-05-22)2248b84c

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-22) to Automated MNLP evaluation report (2026-05-23) 28 days ago

Update Automated MNLP evaluation report (2026-05-23)7c6a238c

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-23) to Automated MNLP evaluation report (2026-05-24) 27 days ago

Update Automated MNLP evaluation report (2026-05-24)f15f466a

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-24) to Automated MNLP evaluation report (2026-05-25) 26 days ago

Update Automated MNLP evaluation report (2026-05-25)f7856a2d

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-25) to Automated MNLP evaluation report (2026-05-26) 25 days ago

Update Automated MNLP evaluation report (2026-05-26)0392b1dd

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-26) to Automated MNLP evaluation report (2026-05-27) 24 days ago

Update Automated MNLP evaluation report (2026-05-27)6933f2f7

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-27) to Automated MNLP evaluation report (2026-05-28) 23 days ago

Update Automated MNLP evaluation report (2026-05-28)559993cb

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-28) to Automated MNLP evaluation report (2026-05-29) 22 days ago

Update Automated MNLP evaluation report (2026-05-29)807d6563

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-05-29) to Automated MNLP evaluation report (2026-06-01) 19 days ago

Update Automated MNLP evaluation report (2026-06-01)b13a6cd8

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-01) to Automated MNLP evaluation report (2026-06-02) 17 days ago

Update Automated MNLP evaluation report (2026-06-02)fafddd61

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-02) to Automated MNLP evaluation report (2026-06-03) 17 days ago

Update Automated MNLP evaluation report (2026-06-03)53d37c41

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-03) to Automated MNLP evaluation report (2026-06-04) 16 days ago

Update Automated MNLP evaluation report (2026-06-04)f4a5d03c

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-04) to Automated MNLP evaluation report (2026-06-06) 14 days ago

Update Automated MNLP evaluation report (2026-06-06)0d0abcea

Backfill evaluated-checkpoint commit5eda8b59

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-06) to Automated MNLP evaluation report (2026-06-08) 12 days ago

Update Automated MNLP evaluation report (2026-06-08)3a3b35aa

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-08) to Automated MNLP evaluation report (2026-06-09) 11 days ago

Update Automated MNLP evaluation report (2026-06-09)a70523a6

Update Automated MNLP evaluation report (2026-06-09)89cd9ad4

VaLeNtln changed pull request status to closed 10 days ago

VaLeNtln changed pull request status to open 10 days ago

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-09) to Automated MNLP evaluation report (2026-06-10) 10 days ago

Update Automated MNLP evaluation report (2026-06-10)3a63e6cf

zechen-nlp changed pull request title from Automated MNLP evaluation report (2026-06-10) to Automated MNLP evaluation report (2026-06-11) 9 days ago

Update Automated MNLP evaluation report (2026-06-11)4051b281

Update Automated MNLP evaluation report (2026-06-11)d1162408

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment