|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- iamtarun/python_code_instructions_18k_alpaca |
|
- angie-chen55/python-github-code |
|
- jtatman/python-code-dataset-500k |
|
language: |
|
- en |
|
base_model: |
|
- facebook/layerskip-llama3.2-1B |
|
library_name: transformers |
|
tags: |
|
- code |
|
--- |
|
# Model Card for CodeDrafter-500M |
|
|
|
A draft model for Llama3.1/3.2/3.3 series models, specialized in python coding. This model is finetuned from the first 4 layers of facebook/layerskip-llama3.2-1B. |
|
|
|
|
|
## Citation |
|
|
|
```bibtex |
|
@article{chen2024sequoia, |
|
title={Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding}, |
|
author={Chen, Zhuoming and May, Avner and Svirschevski, Ruslan and Huang, Yuhsun and Ryabinin, Max and Jia, Zhihao and Chen, Beidi}, |
|
journal={arXiv preprint arXiv:2402.12374}, |
|
year={2024} |
|
} |
|
``` |
|
|
|
|
|
|
|
|
