---
license: apache-2.0
---

This is a Large (780M parameter) Transformer trained for 100k steps on arrival-time encoded music from the [Lakh MIDI dataset](https://colinraffel.com/projects/lmd/). This model was trained with anticipation.

# References for the Anticipatory Music Transformer

The Anticipatory Music Transformer paper is available on [ArXiv](http://arxiv.org/abs/2306.08620).

The full model card is available [here](https://johnthickstun.com/assets/pdf/music-modelcard.pdf).

Code for using this model is available on [GitHub](https://github.com/jthickstun/anticipation/).

See the accompanying [blog post](https://crfm.stanford.edu/2023/06/16/anticipatory-music-transformer.html) for additional discussion of this model.