smgriffin/24thankyou-lyrics
Viewer • Updated • 11 • 14 • 1
How to use smgriffin/24thankyou-lyrics-generator with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="smgriffin/24thankyou-lyrics-generator", device_map="auto") # Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("smgriffin/24thankyou-lyrics-generator")
model = AutoModelForCausalLM.from_pretrained("smgriffin/24thankyou-lyrics-generator", device_map="auto")How to use smgriffin/24thankyou-lyrics-generator with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "smgriffin/24thankyou-lyrics-generator"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "smgriffin/24thankyou-lyrics-generator",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'docker model run hf.co/smgriffin/24thankyou-lyrics-generator
How to use smgriffin/24thankyou-lyrics-generator with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "smgriffin/24thankyou-lyrics-generator" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "smgriffin/24thankyou-lyrics-generator",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "smgriffin/24thankyou-lyrics-generator" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "smgriffin/24thankyou-lyrics-generator",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'How to use smgriffin/24thankyou-lyrics-generator with Docker Model Runner:
docker model run hf.co/smgriffin/24thankyou-lyrics-generator
Midwest indie band 24thankyou lyrics generator, finetuned from gpt2.
You can use the following code to generate lyrics:
from transformers import GPT2LMHeadModel, GPT2Tokenizer, pipeline
# load model
model_name = "smgriffin/24thankyou-lyrics-generator"
model = GPT2LMHeadModel.from_pretrained(model_name)
tokenizer = GPT2Tokenizer.from_pretrained(model_name)
# create text generation pipeline
text_generator = pipeline("text-generation", model=model, tokenizer=tokenizer)
# prompt for lyrics
prompt = f"Lyrics:"
# generate and print
generated_texts = text_generator(
prompt,
max_length=150,
num_return_sequences=1,
temperature=0.9,
top_k=50,
top_p=0.95,
do_sample=True,
)
print("Generated Lyrics:")
print(generated_texts[0]["generated_text"])