README.md

T5-VAE-Python (flax)

A Transformer-VAE made using flax.

It has been trained to interpolate on lines of Python code form the python-lines dataset.

Done as part of Huggingface community training (see forum post).

Builds on T5, using an autoencoder to convert it into an MMD-VAE.

Setup

Run setup_tpu_vm_venv.sh to setup a virtual enviroment.