See our Github repo for more details: https://github.com/hao-ai-lab/Consistency_LLM

Metadata:

AR loss to consistency loss ratio: 10: 1

Spider dataset size: 7k

n-token sequence length: 16

Jacobi trajectory data cleaning: True

Target model: DeepseekCoder fine-tuned on Spider

release date: 02/26/2024