Released fine-tuned QuizGen models
Collection
Most current fine-tuned and tested models for Quizgen downstream task from Rockship Co.
•
4 items
•
Updated
FINAL BENCHMARKING
- Time to First Token (TTFT): 0.001s
- Time Per Output Token (TPOT): 41.83ms/token
- Throughput (token/s): 24.35token/s
- Average Token Latency (ms/token): 41.92ms/token
- Total Generation Time: 18.427s
- Input Tokenization Time: 0.009s
- Input Tokens: 1909
- Output Tokens: 443
- Total Tokens: 2352
- Memory Usage (GPU): 3.38GB
Uploaded model
- Developed by: vietphuon
- License: apache-2.0
- Finetuned from model : unsloth/Llama-3.2-1B-Instruct-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.
Model tree for vietphuon/Llama-3.2-1B-Instruct-bnb-4bit-alpaca-then-quizgen-241016-1
Base model
meta-llama/Llama-3.2-1B-Instruct
Quantized
unsloth/Llama-3.2-1B-Instruct-bnb-4bit